00000040:00080000:3.0F:1788797304.627773:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0F:1788797304.949178:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788797305.909610:0:17220:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788797305.909632:0:17220:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a23f909e900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788797305.909638:0:17220:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a23c4962000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a23f909e840 00000020:00080000:3.0:1788797305.909641:0:17220:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a23c4962c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a23c765bc00 00010000:00010000:1.0F:1788797305.909772:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909817:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909827:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909833:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797305.909840:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909850:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909876:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a23efa4b200) 00010000:00010000:1.0:1788797305.909879:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797305.909887:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797305.909894:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045200/0x6418c0ce308ce10d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20378 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0F:1788797305.919159:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1788797305.919253:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788797305.970956:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797306.421914:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390438784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797306.421987:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797306.422042:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390438784 00000100:00100000:2.0:1788797306.422051:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390438784 00000100:00100000:2.0:1788797306.422105:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797306.422117:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390438784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788797306.422144:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788797306.422185:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390438784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797306.422192:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788797306.422213:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797306.422249:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390438784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797306.422739:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797306.422751:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390438912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797306.422834:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797306.423215:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390438912 00000100:00100000:2.0:1788797306.423221:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390438912 00000100:00100000:2.0:1788797306.423278:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797306.423286:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390438912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788797306.423301:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788797306.423343:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390438912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797306.423349:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797306.423385:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390438912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788797306.423499:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788797307.007672:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797307.445661:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797307.445671:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797307.445685:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390439168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797307.445685:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390439040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797307.458608:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797307.458702:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439168 00000100:00100000:3.0:1788797307.458713:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439168 00000100:00100000:3.0:1788797307.458785:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788797307.458815:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390439168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797307.458852:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797307.458938:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390439168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797307.458945:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788797307.458968:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797307.459008:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390439168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797307.464330:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797307.464376:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439040 00000100:00100000:1.0:1788797307.464386:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439040 00000100:00100000:1.0:1788797307.464458:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797307.464485:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390439040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797307.464515:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797307.464565:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390439040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797307.464571:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788797307.464591:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797307.464636:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390439040:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788797308.021118:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797308.148074:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797308.149464:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376723968 00000100:00100000:3.0:1788797308.149485:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376723968 00000100:00100000:3.0:1788797308.149604:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:3.0:1788797308.149616:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:15611:x1875689376723968:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788797308.149738:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:15611:x1875689376723968:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 125us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797308.149761:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00080000:1.0:1788797308.152331:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797308.161462:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797308.161656:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724096 00000100:00100000:1.0:1788797308.161668:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724096 00000100:00100000:1.0:1788797308.161763:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:1.0:1788797308.161780:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:15611:x1875689376724096:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788797308.161956:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:15611:x1875689376724096:12345-192.168.202.33@tcp:60:lhsmtool_posix.0 Request processed in 181us (503us total) trans 0 rc 0/0 00000100:00080000:3.0:1788797308.162149:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797308.162248:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:3.0:1788797308.168578:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797308.168763:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724352 00000100:00100000:1.0:1788797308.168778:0:17243:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724352 00000100:00100000:1.0:1788797308.168877:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1788797308.168888:0:17243:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:15611:x1875689376724352:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797308.169185:0:17243:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+14:15611:x1875689376724352:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 298us (616us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788797308.169193:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:0.0:1788797308.194251:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194341:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194370:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194395:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194428:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194450:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194474:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797308.194507:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724736 00000100:00100000:0.0:1788797308.194519:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724736 00000100:00100000:0.0:1788797308.194572:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724608 00000100:00100000:0.0:1788797308.194575:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724608 00000100:00100000:0.0:1788797308.194590:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725120 00000100:00100000:0.0:1788797308.194592:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725120 00000100:00100000:0.0:1788797308.194607:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725248 00000100:00100000:0.0:1788797308.194610:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725248 00000100:00100000:0.0:1788797308.194628:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:0.0:1788797308.194638:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2407:x1875689376724736:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797308.194715:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2407:x1875689376724736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.194722:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:0.0:1788797308.194738:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1788797308.194744:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2403:x1875689376724608:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:0.0:1788797308.194765:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde3c 00000100:00080000:0.0:1788797308.194782:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a22c4147000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788797308.194866:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788797308.195103:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+2:2403:x1875689376724608:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 358us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.195110:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1788797308.195123:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:0.0:1788797308.195129:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37223492-d87c-454e-b62e-aca3f82fa82c+5:2403:x1875689376725120:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:0.0:1788797308.195140:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde82 00000100:00080000:0.0:1788797308.195145:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a2400901800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788797308.195164:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788797308.195215:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37223492-d87c-454e-b62e-aca3f82fa82c+2:2403:x1875689376725120:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 85us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.195221:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:0.0:1788797308.195233:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1788797308.195239:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37223492-d87c-454e-b62e-aca3f82fa82c+5:2403:x1875689376725248:12345-192.168.202.33@tcp:9:kworker.0 00000020:00000080:0.0:1788797308.195251:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde7b 00000100:00080000:0.0:1788797308.195258:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a22c4147800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788797308.195274:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788797308.195339:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37223492-d87c-454e-b62e-aca3f82fa82c+2:2403:x1875689376725248:12345-192.168.202.33@tcp:9:kworker.0 Request processed in 99us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.195346:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1788797308.195375:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724864 00000100:00100000:0.0:1788797308.195379:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724864 00000100:00100000:0.0:1788797308.195424:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724992 00000100:00100000:0.0:1788797308.195427:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724992 00000100:00100000:0.0:1788797308.195449:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:0.0:1788797308.195456:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37223492-d87c-454e-b62e-aca3f82fa82c+6:2407:x1875689376724864:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797308.195485:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37223492-d87c-454e-b62e-aca3f82fa82c+6:2407:x1875689376724864:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.195499:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 74 00000100:00100000:0.0:1788797308.195512:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 75 00000100:00100000:0.0:1788797308.195518:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37223492-d87c-454e-b62e-aca3f82fa82c+5:2407:x1875689376724992:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797308.195543:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37223492-d87c-454e-b62e-aca3f82fa82c+5:2407:x1875689376724992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 26us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.195549:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 75 00010000:00010000:3.0:1788797308.195744:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797308.195752:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797308.195759:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788797308.195763:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797308.195765:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788797308.195767:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797308.200996:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376724480 00000100:00100000:1.0:1788797308.201015:0:17235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376724480 00000100:00100000:1.0:1788797308.201089:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:1.0:1788797308.201100:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc1654e8-ba4c-430d-84ef-214706f1c8da+13:2407:x1875689376724480:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797308.201214:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc1654e8-ba4c-430d-84ef-214706f1c8da+13:2407:x1875689376724480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 115us (6979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797308.201223:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 169 00000100:00100000:2.0:1788797308.467985:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797308.468008:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390439296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797308.468079:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797308.468129:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439296 00000100:00100000:2.0:1788797308.468137:0:17245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439296 00000100:00100000:2.0:1788797308.468196:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788797308.468205:0:17245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390439296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797308.468240:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788797308.468287:0:17245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390439296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797308.468294:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788797308.468342:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390439296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797308.979271:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797308.979295:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390439424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797308.979372:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797308.979431:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439424 00000100:00100000:0.0:1788797308.979439:0:20432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439424 00000100:00100000:0.0:1788797308.979506:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788797308.979517:0:20432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390439424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797308.979556:0:20432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797308.979615:0:20432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390439424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797308.979623:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:1.0:1788797308.979760:0:17276:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788797308.979764:0:17276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797308.979782:0:17276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788797308.979813:0:17276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788797308.979855:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390439424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788797309.043133:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797309.491123:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d5a02fe-c590-4f5d-9073-3000c2955450:3618:1875689390439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.491143:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797309.491157:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390439808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.491224:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390439680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.500091:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.500375:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797309.501013:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797309.501073:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439552 00000100:00100000:3.0:1788797309.501082:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439552 00000100:00100000:3.0:1788797309.501132:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788797309.501141:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3618:x1875689390439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501201:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3618:x1875689390439552:12345-0@lo:400:kworker.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797309.501208:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788797309.501252:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff51d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d5a02fe-c590-4f5d-9073-3000c2955450:3618:1875689390439552:0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501280:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797309.501288:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390439936:0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501318:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797309.501346:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439936 00000100:00100000:3.0:1788797309.501350:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439936 00000100:00100000:3.0:1788797309.501381:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797309.501421:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501462:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390439936:12345-0@lo:400:kworker.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797309.501468:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788797309.501483:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797309.501504:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390439936:0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501539:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797309.501544:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390440192:0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.501565:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.501718:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390440064:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.501750:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.501784:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440064 00000100:00100000:1.0:1788797309.501800:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440064 00000100:00100000:1.0:1788797309.501829:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788797309.501835:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390440064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.501868:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390440064:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797309.501874:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788797309.501900:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390440064:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.503223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.503446:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439808 00000100:00100000:1.0:1788797309.503456:0:18749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439808 00000100:00100000:1.0:1788797309.503516:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788797309.503537:0:18749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390439808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.503594:0:18749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390439808:12345-0@lo:400:kworker.0 Request processed in 61us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797309.503600:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788797309.503619:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797309.503657:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390439808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.503945:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504094:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504119:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390440832:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504209:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504233:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788797309.504238:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390440448:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504257:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504270:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875689390440960:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504286:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504381:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390440704:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504419:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504438:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797309.504443:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23ff512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390440576:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504463:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504478:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390441088:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504495:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797309.504514:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440832 00000100:00100000:1.0:1788797309.504519:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440832 00000100:00100000:0.0:1788797309.504560:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440960 00000100:00100000:0.0:1788797309.504564:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440960 00000100:00100000:0.0:1788797309.504593:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440704 00000100:00100000:0.0:1788797309.504597:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440704 00000100:00100000:0.0:1788797309.504610:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440576 00000100:00100000:0.0:1788797309.504612:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440576 00000100:00100000:0.0:1788797309.504621:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441088 00000100:00100000:0.0:1788797309.504623:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441088 00000100:00100000:1.0:1788797309.504726:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788797309.504746:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875689390440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504803:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875689390440960:12345-0@lo:400:kworker.0 Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797309.504809:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788797309.504823:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788797309.504828:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788797309.504828:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.504835:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.504858:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390440704:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797309.504860:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390440576:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797309.504864:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788797309.504867:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788797309.504874:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788797309.504891:0:19150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440320 00000100:00100000:3.0:1788797309.504895:0:19150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440320 00000100:00100000:3.0:1788797309.504920:0:19150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440448 00000100:00100000:3.0:1788797309.504922:0:19150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440448 00000100:00100000:3.0:1788797309.504940:0:19150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797309.504946:0:19150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.504975:0:19150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390440320:12345-0@lo:400:kworker.0 Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797309.504981:0:19150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797309.504992:0:19150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788797309.504998:0:19150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390440448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797309.505024:0:19150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390440448:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797309.505039:0:19150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788797309.508049:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788797309.508066:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390441088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.508198:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390441088:12345-0@lo:400:kworker.0 Request processed in 136us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797309.508205:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788797309.508246:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788797309.508251:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797309.508255:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797309.508257:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797309.508352:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390440448:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.508366:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875689390440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.508377:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390440320:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.508435:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390440576:0@lo:400:kworker.0 00010000:00080000:0.0:1788797309.508449:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c40c1880 x1875689390441088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797309.508461:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788797309.508472:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390440704:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.510860:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.511110:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390440832:12345-0@lo:400:kworker.0 Request processed in 6229us (6899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797309.511121:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1788797309.511753:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23ff510a80 x1875689390440832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797309.511770:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390440832:0@lo:400:kworker.0 00000100:00100000:2.0:1788797309.512544:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390439680 00000100:00100000:2.0:1788797309.512553:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390439680 00000100:00100000:2.0:1788797309.512625:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390440192 00000100:00100000:2.0:1788797309.512628:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390440192 00000100:00100000:2.0:1788797309.512645:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797309.512653:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390439680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797309.512738:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390439680:12345-0@lo:400:kworker.0 Request processed in 85us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797309.512744:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797309.512760:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788797309.512766:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390440192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797309.512821:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390440192:12345-0@lo:400:kworker.0 Request processed in 55us (11253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797309.512826:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788797309.512877:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390440192:0@lo:400:kworker.0 00000100:00100000:1.0:1788797309.512891:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23ff51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390439680:0@lo:400:kworker.0 00010000:00010000:0.0:1788797310.067342:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788797310.502230:0:20615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:08:28 (1788797308) 00010000:00010000:0.0:1788797311.093408:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797311.545096:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797311.545187:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390441216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797311.545331:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797311.545436:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390441344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797311.545463:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797311.545613:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441216 00000100:00100000:3.0:1788797311.545622:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441216 00000100:00100000:3.0:1788797311.545682:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441344 00000100:00100000:3.0:1788797311.545685:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441344 00000100:00100000:3.0:1788797311.545702:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797311.545712:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390441216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788797311.545741:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788797311.545838:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390441216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797311.545846:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797311.545865:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797311.545871:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390441344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797311.545881:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788797311.545909:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390441344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797311.545914:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788797311.546386:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797311.546617:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390441344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797311.546656:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390441216:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788797312.065583:0:17220:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788797312.065609:0:17220:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788797312.065646:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788797312.065659:0:17280:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1788797312.116648:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797312.566082:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390441472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797312.566166:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797312.566450:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441472 00000100:00100000:1.0:1788797312.566459:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441472 00000100:00100000:1.0:1788797312.566523:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788797312.566533:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390441472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797312.566569:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797312.566617:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390441472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797312.566624:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788797312.567728:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797312.567777:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390441472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797312.570997:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390441600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797312.571081:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797312.573403:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441600 00000100:00100000:1.0:1788797312.573427:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441600 00000100:00100000:1.0:1788797312.573505:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788797312.573516:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390441600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797312.573542:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797312.573624:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390441600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797312.573631:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788797312.576092:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390441600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788797312.576639:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788797313.139571:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797313.300198:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797313.300255:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797313.300307:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797313.300358:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797313.300424:0:19150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725760 00000100:00100000:3.0:1788797313.300434:0:19150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725760 00000100:00100000:3.0:1788797313.300498:0:19150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:3.0:1788797313.300508:0:19150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2406:x1875689376725760:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797313.300597:0:19150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2406:x1875689376725760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797313.300605:0:19150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00080000:3.0:1788797313.300629:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797313.300751:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725376 00000100:00100000:3.0:1788797313.300756:0:17234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725376 00000100:00100000:3.0:1788797313.300782:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 171 00000100:00100000:3.0:1788797313.300824:0:17234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc1654e8-ba4c-430d-84ef-214706f1c8da+13:2406:x1875689376725376:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797313.300854:0:17234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc1654e8-ba4c-430d-84ef-214706f1c8da+13:2406:x1875689376725376:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 65us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797313.300860:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 171 00000100:00100000:0.0:1788797313.301220:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797313.314329:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725504 00000100:00100000:2.0:1788797313.314347:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725504 00000100:00100000:2.0:1788797313.314445:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726016 00000100:00100000:2.0:1788797313.314449:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726016 00000100:00100000:2.0:1788797313.314487:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:2.0:1788797313.314501:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:2406:x1875689376725504:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797313.314603:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:2406:x1875689376725504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (14417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797313.314610:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 82 00000100:00100000:2.0:1788797313.314629:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 83 00000100:00100000:2.0:1788797313.314637:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37223492-d87c-454e-b62e-aca3f82fa82c+5:2406:x1875689376726016:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797313.314681:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37223492-d87c-454e-b62e-aca3f82fa82c+5:2406:x1875689376726016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 45us (14375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797313.314687:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 83 00000100:00080000:3.0:1788797313.315136:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788797313.315143:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797313.326187:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797313.326453:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725632 00000100:00100000:1.0:1788797313.326464:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725632 00000100:00100000:1.0:1788797313.326541:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376725888 00000100:00100000:1.0:1788797313.326545:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376725888 00000100:00100000:1.0:1788797313.326575:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:1.0:1788797313.326585:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2406:x1875689376725632:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797313.326659:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2406:x1875689376725632:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (25441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797313.326667:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 84 00000100:00100000:1.0:1788797313.326686:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 85 00000100:00100000:1.0:1788797313.326692:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37223492-d87c-454e-b62e-aca3f82fa82c+6:2406:x1875689376725888:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797313.326716:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37223492-d87c-454e-b62e-aca3f82fa82c+6:2406:x1875689376725888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797313.326721:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 85 00000100:00080000:3.0:1788797313.326988:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797313.326993:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788797313.587574:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390441728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797313.587668:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797313.588007:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441728 00000100:00100000:2.0:1788797313.588016:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441728 00000100:00100000:2.0:1788797313.588073:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788797313.588084:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390441728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797313.588121:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788797313.588185:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390441728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797313.588192:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788797313.588747:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390441728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797314.106679:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788797314.106705:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390441856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797314.106782:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797314.111745:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441856 00000100:00100000:3.0:1788797314.111760:0:20432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441856 00000100:00100000:3.0:1788797314.111865:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797314.111875:0:20432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390441856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797314.111934:0:20432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797314.112033:0:20432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390441856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (5250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797314.112040:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788797314.114169:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390441856:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788797314.121393:0:19560:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37223492-d87c-454e-b62e-aca3f82fa82c 00000020:00000080:2.0:1788797314.121405:0:19560:0:(genops.c:885:class_export_put()) final put ffff9a22c4140000/37223492-d87c-454e-b62e-aca3f82fa82c 00000020:00000080:1.0:1788797314.122121:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4140000/37223492-d87c-454e-b62e-aca3f82fa82c for lustre-OST0001 00000020:00000080:1.0:1788797314.122184:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4147800 for lustre-OST0001 00000001:00100000:0.0:1788797314.122333:0:18743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37223492-d87c-454e-b62e-aca3f82fa82c 00000020:00000080:0.0:1788797314.122337:0:18743:0:(genops.c:885:class_export_put()) final put ffff9a23c835c000/37223492-d87c-454e-b62e-aca3f82fa82c 00000001:00100000:0.0:1788797314.122364:0:18743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:0.0:1788797314.122366:0:18743:0:(genops.c:885:class_export_put()) final put ffff9a22c4145800/e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:1.0:1788797314.122412:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c835c000/37223492-d87c-454e-b62e-aca3f82fa82c for lustre-OST0000 00000020:00000080:1.0:1788797314.122434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4145800/e2d316d7-5091-401b-8a2a-4413c2cfe0af for lustre-OST0000 00000020:00000080:1.0:1788797314.122445:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a2400901800 for lustre-OST0000 00000020:00000080:1.0:1788797314.122448:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4147000 for lustre-OST0000 00010000:00010000:1.0:1788797314.163167:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797314.611160:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390442112:0@lo:400:kworker.0 00000100:00100000:3.0:1788797314.611248:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797314.611373:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797314.611389:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611421:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797314.611458:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390441984 00000100:00100000:0.0:1788797314.611466:0:17235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390441984 00000100:00100000:0.0:1788797314.611509:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788797314.611517:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3616:x1875689390441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611580:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3616:x1875689390441984:12345-0@lo:400:kworker.0 Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.611597:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788797314.611643:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611681:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390442240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611707:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797314.611733:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442240 00000100:00100000:0.0:1788797314.611736:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442240 00000100:00100000:0.0:1788797314.611769:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788797314.611775:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390442240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611831:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390442240:12345-0@lo:400:kworker.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.611844:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788797314.611862:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797314.611884:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390442240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797314.611911:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442112 00000100:00100000:0.0:1788797314.611915:0:17245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442112 00000100:00100000:0.0:1788797314.611942:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797314.611949:0:17245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390442112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614235:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390442496:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614297:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614329:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390443008:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614361:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614377:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390443520:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614395:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614415:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788797314.614420:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390442368:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614442:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614459:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390442880:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614478:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614496:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875689390443392:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.614546:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797314.614578:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442368 00000100:00100000:1.0:1788797314.614707:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442496 00000100:00100000:1.0:1788797314.614715:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442496 00000100:00100000:1.0:1788797314.614751:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443008 00000100:00100000:1.0:1788797314.614753:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443008 00000100:00100000:1.0:1788797314.614762:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443520 00000100:00100000:1.0:1788797314.614765:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443520 00000100:00080000:1.0:1788797314.614809:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797314.614825:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443392 00000100:00100000:1.0:1788797314.614828:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443392 00000100:00080000:1.0:1788797314.614841:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797314.614871:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788797314.614880:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390442496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.614936:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390442496:12345-0@lo:400:kworker.0 Request processed in 57us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.614943:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788797314.614995:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390442496:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615018:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788797314.615024:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615055:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390443008:12345-0@lo:400:kworker.0 Request processed in 32us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615071:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788797314.615096:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390443008:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615114:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788797314.615120:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875689390443520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615151:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875689390443520:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615156:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788797314.615178:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23fa763b80 x1875689390443520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797314.615188:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390443520:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615203:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788797314.615210:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875689390443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615239:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875689390443392:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615244:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788797314.615263:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875689390443392:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615298:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390442752:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615322:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797314.615353:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615374:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797314.615393:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797314.615398:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615421:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797314.615451:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390443136:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615472:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797314.615491:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442880 00000100:00100000:1.0:1788797314.615496:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442880 00000100:00100000:1.0:1788797314.615526:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442752 00000100:00100000:1.0:1788797314.615529:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442752 00000100:00100000:1.0:1788797314.615545:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788797314.615551:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390442880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615601:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390442880:12345-0@lo:400:kworker.0 Request processed in 49us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615606:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788797314.615617:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788797314.615622:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390442752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615649:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390442752:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615654:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788797314.615668:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797314.615671:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797314.615680:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390442624 00000100:00100000:1.0:1788797314.615684:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442624 00000100:00100000:1.0:1788797314.615705:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788797314.615710:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390442624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615737:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390442624:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615742:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788797314.615766:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615774:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390442752:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615835:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390442880:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615848:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443264 00000100:00100000:1.0:1788797314.615851:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443264 00000100:00080000:1.0:1788797314.615863:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797314.615876:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443136 00000100:00100000:1.0:1788797314.615878:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443136 00000100:00080000:1.0:1788797314.615887:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797314.615898:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788797314.615904:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615935:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390443264:12345-0@lo:400:kworker.0 Request processed in 31us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.615941:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1788797314.615962:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23fa761c00 x1875689390443264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797314.615972:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.615993:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788797314.615999:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797314.616027:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390443136:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.616033:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788797314.616054:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390443136:0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.619149:0:18749:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390442368 00000100:00100000:2.0:1788797314.619252:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797314.619263:0:18749:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390442368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797314.619373:0:18749:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390442368:12345-0@lo:400:kworker.0 Request processed in 112us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797314.619379:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797314.619437:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390442368:0@lo:400:kworker.0 00000100:00080000:1.0:1788797314.622858:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797314.623327:0:17245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390442112:12345-0@lo:400:kworker.0 Request processed in 11370us (12071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.623352:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788797314.623775:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390442112:0@lo:400:kworker.0 00000040:00080000:2.0:1788797314.868296:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788797314.962520:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797314.962961:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726272 00000100:00100000:0.0:1788797314.962971:0:17244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726272 00000100:00100000:0.0:1788797314.963076:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:0.0:1788797314.963099:0:17244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d316d7-5091-401b-8a2a-4413c2cfe0af+13:16364:x1875689376726272:12345-192.168.202.33@tcp:35:umount.0 00000001:00080000:0.0:1788797314.963412:0:17244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1788797314.963544:0:17244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d316d7-5091-401b-8a2a-4413c2cfe0af+15:16364:x1875689376726272:12345-192.168.202.33@tcp:35:umount.0 Request processed in 448us (1034us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1788797314.963553:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000020:00080000:0.0:1788797314.963558:0:17244:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788797314.967330:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797314.967391:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797314.967424:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797314.967464:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797314.967554:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726528 00000100:00100000:0.0:1788797314.967566:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726528 00000100:00100000:0.0:1788797314.967646:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726400 00000100:00100000:0.0:1788797314.967649:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726400 00000100:00100000:0.0:1788797314.967664:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726656 00000100:00100000:0.0:1788797314.967667:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726656 00000100:00100000:0.0:1788797314.967685:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1788797314.967694:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+15:2406:x1875689376726528:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797314.967725:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797314.967746:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2402045e00/0x6418c0ce308cde20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca7f87 expref: 15 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.967765:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797314.967849:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+14:2406:x1875689376726528:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 156us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.967857:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:0.0:1788797314.967877:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:0.0:1788797314.967883:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240170e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+13:2406:x1875689376726400:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797314.967891:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797314.967900:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084ac00/0x6418c0ce308cde19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca7f56 expref: 13 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.967909:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797314.967940:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240170e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+12:2406:x1875689376726400:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 56us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.967946:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:0.0:1788797314.967985:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:0.0:1788797314.967992:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+11:2406:x1875689376726656:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797314.967999:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797314.968008:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084b000/0x6418c0ce308cdea5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca803d expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.968016:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797314.968033:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+10:2406:x1875689376726656:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 42us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797314.968046:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:1.0:1788797314.969297:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376726784 00000100:00100000:1.0:1788797314.969310:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376726784 00000100:00100000:1.0:1788797314.969382:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:1.0:1788797314.969391:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2403:x1875689376726784:12345-192.168.202.33@tcp:9:umount.0 00000020:00000080:1.0:1788797314.969438:0:18748:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde43 00000100:00080000:1.0:1788797314.969448:0:18748:0:(import.c:65:import_set_state_nolock()) ffff9a22c4144000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797314.969497:0:18748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:0.0:1788797314.969700:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797314.969818:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d316d7-5091-401b-8a2a-4413c2cfe0af+2:2403:x1875689376726784:12345-192.168.202.33@tcp:9:umount.0 Request processed in 398us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797314.969827:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1788797314.994300:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797314.994966:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376727680 00000100:00100000:1.0:1788797314.994978:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376727680 00000100:00100000:1.0:1788797314.995282:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:1.0:1788797314.995293:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+15:2403:x1875689376727680:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:1.0:1788797314.995329:0:17240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde35 00000020:00010000:1.0:1788797314.995359:0:17240:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a22c4396800: total 0 00000100:00080000:1.0:1788797314.995365:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9a22c4393000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797314.995434:0:17240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1788797314.995700:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d316d7-5091-401b-8a2a-4413c2cfe0af+14:2403:x1875689376727680:12345-192.168.202.33@tcp:39:umount.0 Request processed in 406us (1409us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788797314.995709:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000020:00010000:0.0:1788797314.998782:0:17230:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a22c4396800: total 0 00010000:00010000:0.0:1788797314.998859:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797314.999043:0:17230:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a22c4396800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788797314.999362:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a23c3ec4f00) 00010000:00010000:0.0:1788797314.999367:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797314.999378:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515000/0x6418c0ce308cdef9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8044 expref: 13 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999405:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a23efa4bb00) 00010000:00010000:0.0:1788797314.999408:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788797314.999412:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c49e9c00/0x6418c0ce308cdfd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8083 expref: 12 pid: 20378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999442:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a23f9fad000) 00010000:00010000:0.0:1788797314.999445:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797314.999461:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c49e9200/0x6418c0ce308ce088 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca80c2 expref: 11 pid: 20378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999475:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a23f9fad000) 00010000:00010000:0.0:1788797314.999490:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797314.999494:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402044200/0x6418c0ce308ce13e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca80fa expref: 10 pid: 20378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999509:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a22c1f6af00) 00010000:00010000:0.0:1788797314.999522:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797314.999538:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cdf15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca804b expref: 9 pid: 20378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999574:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a23f9fad000) 00010000:00010000:0.0:1788797314.999576:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788797314.999580:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308ce057 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca80ad expref: 8 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999595:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23c3ec4700) 00010000:00010000:0.0:1788797314.999597:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797314.999601:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515a00/0x6418c0ce308cdf54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8059 expref: 7 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999614:0:17230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a23efa4b200) 00010000:00010000:0.0:1788797314.999616:0:17230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797314.999620:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2402045400/0x6418c0ce308ce0e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca80d7 expref: 6 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797314.999635:0:17230:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a22c4396800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1788797314.999650:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797314.999652:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797314.999654:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797315.033697:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797315.035077:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376727808 00000100:00100000:1.0:1788797315.035309:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376727808 00000100:00100000:1.0:1788797315.035409:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:1.0:1788797315.035422:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+5:2403:x1875689376727808:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:1.0:1788797315.035460:0:20378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde2e 00000100:00080000:1.0:1788797315.035481:0:20378:0:(import.c:65:import_set_state_nolock()) ffff9a22c4391000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797315.035516:0:20378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788797315.035782:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d316d7-5091-401b-8a2a-4413c2cfe0af+3:2403:x1875689376727808:12345-192.168.202.33@tcp:39:umount.0 Request processed in 363us (2094us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788797315.035842:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00010000:00010000:3.0:1788797315.036020:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797315.037391:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788797315.187283:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797316.211034:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797316.659347:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797316.659373:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797316.659462:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797316.659594:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443648 00000100:00100000:1.0:1788797316.659603:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443648 00000100:00100000:1.0:1788797316.659662:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788797316.659672:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390443648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797316.659699:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797316.659742:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390443648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797316.659748:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788797316.659863:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797316.659899:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797316.660149:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797316.660160:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390443776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797316.660195:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797316.660265:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443776 00000100:00100000:1.0:1788797316.660269:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443776 00000100:00100000:1.0:1788797316.660315:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788797316.660331:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390443776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788797316.660344:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797316.660377:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390443776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797316.660382:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788797316.660477:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390443776:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788797316.660697:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788797317.235824:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797317.683088:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390443904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797317.683163:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797317.683318:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390443904 00000100:00100000:1.0:1788797317.683327:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390443904 00000100:00100000:1.0:1788797317.683391:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788797317.683401:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390443904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797317.683430:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797317.683482:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390443904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797317.683489:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788797317.683600:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390443904:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788797317.683745:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797317.683932:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797317.689117:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390444032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797317.689202:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797317.690474:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444032 00000100:00100000:1.0:1788797317.690501:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444032 00000100:00100000:1.0:1788797317.690680:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788797317.690689:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390444032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797317.690717:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797317.690811:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390444032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797317.690818:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797317.690945:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390444032:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797317.691158:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797318.093922:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797318.093974:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797318.094265:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376727936 00000100:00100000:2.0:1788797318.094277:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376727936 00000100:00100000:2.0:1788797318.094378:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728064 00000100:00100000:2.0:1788797318.094382:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728064 00000100:00100000:2.0:1788797318.094425:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1788797318.094437:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc1654e8-ba4c-430d-84ef-214706f1c8da+11:2405:x1875689376727936:12345-192.168.202.33@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788797318.094467:0:18394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00010000:00010000:2.0:1788797318.094473:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788797318.094480:0:18394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc1654e8-ba4c-430d-84ef-214706f1c8da+11:2405:x1875689376728064:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797318.094491:0:18394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797318.094497:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401514600/0x6418c0ce308cde58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca7fc6 expref: 11 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797318.094505:0:18394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401514c00/0x6418c0ce308cde5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca7ff7 expref: 11 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797318.094521:0:18394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797318.094521:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797318.094852:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc1654e8-ba4c-430d-84ef-214706f1c8da+9:2405:x1875689376727936:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 415us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797318.094861:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:3.0:1788797318.100755:0:18394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cc1654e8-ba4c-430d-84ef-214706f1c8da+8:2405:x1875689376728064:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 6267us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797318.100772:0:18394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1788797318.101085:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797318.101434:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728192 00000100:00100000:3.0:1788797318.101443:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728192 00000100:00100000:3.0:1788797318.101504:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:3.0:1788797318.101512:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+8:2404:x1875689376728192:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797318.101525:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797318.101545:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2402045800/0x6418c0ce308cde9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8036 expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797318.101563:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797318.101594:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc1654e8-ba4c-430d-84ef-214706f1c8da+7:2404:x1875689376728192:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 83us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797318.101600:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:3.0:1788797318.110356:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797318.110434:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728448 00000100:00100000:1.0:1788797318.110445:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728448 00000100:00100000:1.0:1788797318.110525:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1788797318.110535:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37223492-d87c-454e-b62e-aca3f82fa82c+6:2403:x1875689376728448:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:1.0:1788797318.110573:0:17240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde6d 00000020:00010000:1.0:1788797318.110581:0:17240:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a22c327b000: total 0 00000100:00080000:1.0:1788797318.110585:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9a22c327d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788797318.110648:0:17240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788797318.110820:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37223492-d87c-454e-b62e-aca3f82fa82c+5:2403:x1875689376728448:12345-192.168.202.33@tcp:39:umount.0 Request processed in 286us (472us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788797318.110844:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000020:00010000:0.0:1788797318.111084:0:17229:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a22c327b000: total 0 00010000:00010000:0.0:1788797318.111133:0:17229:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a22c327b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788797318.111167:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23c3ec4700) 00010000:00010000:0.0:1788797318.111170:0:17229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797318.111179:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c49e8800/0x6418c0ce308cdf62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8060 expref: 4 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797318.111201:0:17229:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a22c327b000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788797318.111224:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797318.111226:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797318.111228:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797318.112674:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797318.123350:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797318.123495:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728576 00000100:00100000:2.0:1788797318.123506:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728576 00000100:00100000:2.0:1788797318.123566:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1788797318.123574:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37223492-d87c-454e-b62e-aca3f82fa82c+5:2403:x1875689376728576:12345-192.168.202.33@tcp:39:umount.0 00000020:00000080:2.0:1788797318.123608:0:20378:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde74 00000100:00080000:2.0:1788797318.123616:0:20378:0:(import.c:65:import_set_state_nolock()) ffff9a22c3279800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788797318.123635:0:20378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788797318.123763:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37223492-d87c-454e-b62e-aca3f82fa82c+3:2403:x1875689376728576:12345-192.168.202.33@tcp:39:umount.0 Request processed in 189us (421us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788797318.123771:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00010000:00010000:2.0:1788797318.123820:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797318.124124:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797318.160749:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797318.160911:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728832 00000100:00100000:3.0:1788797318.160922:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728832 00000100:00100000:3.0:1788797318.160981:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 173 00000100:00100000:3.0:1788797318.160992:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc1654e8-ba4c-430d-84ef-214706f1c8da+7:2403:x1875689376728832:12345-192.168.202.33@tcp:251:umount.0 00000020:00000080:3.0:1788797318.161036:0:17236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cde0b 00000020:00010000:3.0:1788797318.161045:0:17236:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a22c2ce4000: total 0 00000100:00080000:3.0:1788797318.161051:0:17236:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce7800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788797318.161284:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc1654e8-ba4c-430d-84ef-214706f1c8da+3:2403:x1875689376728832:12345-192.168.202.33@tcp:251:umount.0 Request processed in 293us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797318.161293:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 173 00000020:00010000:1.0:1788797318.162564:0:17229:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a22c2ce4000: total 0 00010000:00010000:1.0:1788797318.162572:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797318.162637:0:17229:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a22c2ce4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788797318.162674:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2402044a00/0x6418c0ce308cde12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca7f4f expref: 2 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797318.162703:0:17229:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a22c2ce4000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788797318.162714:0:17229:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce4000/cc1654e8-ba4c-430d-84ef-214706f1c8da 00010000:00010000:1.0:1788797318.162743:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797318.162745:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797318.162747:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788797318.164225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce4000/cc1654e8-ba4c-430d-84ef-214706f1c8da for MGS 00000020:00000080:3.0:1788797318.164271:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ce7800 for MGS 00000040:00080000:2.0:1788797318.195386:0:17276:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797318.195396:0:17276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797318.195420:0:17276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788797318.195429:0:17276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788797318.260866:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797318.708036:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390444160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797318.708109:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797318.708200:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444160 00000100:00100000:1.0:1788797318.708210:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444160 00000100:00100000:1.0:1788797318.708264:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788797318.708274:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390444160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788797318.708323:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788797318.708375:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390444160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797318.708382:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797318.709389:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390444160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797319.219811:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797319.219835:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390444288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797319.219914:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797319.219984:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444288 00000100:00100000:3.0:1788797319.219991:0:17245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444288 00000100:00100000:3.0:1788797319.220038:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797319.220158:0:17245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390444288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797319.220194:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797319.220243:0:17245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390444288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797319.220251:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797319.220316:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390444288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788797319.286088:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797319.733734:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390444544:0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.734105:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390444416:0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.734142:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734188:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734223:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734244:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734258:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390445568:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734302:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734336:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734356:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734373:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734390:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734402:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875689390445696:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734417:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734432:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788797319.734437:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390444800:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.734452:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.734464:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c33b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390445312:0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.734571:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390444928:0@lo:400:kworker.0 00000100:00100000:3.0:1788797319.734664:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444416 00000100:00100000:3.0:1788797319.734673:0:17234:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444416 00000100:00100000:3.0:1788797319.734717:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788797319.734725:0:17234:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3616:x1875689390444416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.734956:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.736150:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797319.736314:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.736360:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797319.736401:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390444416:0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.737751:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444544 00000100:00100000:1.0:1788797319.737763:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444544 00000100:00100000:1.0:1788797319.737953:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445056 00000100:00100000:1.0:1788797319.737957:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445056 00000100:00100000:1.0:1788797319.737975:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444672 00000100:00100000:1.0:1788797319.737978:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444672 00000100:00100000:1.0:1788797319.737990:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445184 00000100:00100000:1.0:1788797319.737992:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445184 00000100:00100000:1.0:1788797319.738010:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797319.738020:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390444544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.738940:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390444544:12345-0@lo:400:kworker.0 Request processed in 916us (4899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.738951:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797319.738977:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797319.738987:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390445056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739018:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390445056:12345-0@lo:400:kworker.0 Request processed in 34us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739023:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797319.739034:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797319.739167:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390444672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739198:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390444672:12345-0@lo:400:kworker.0 Request processed in 35us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739205:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797319.739217:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788797319.739223:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390445184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739252:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390445184:12345-0@lo:400:kworker.0 Request processed in 29us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739257:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788797319.739283:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445568 00000100:00100000:1.0:1788797319.739298:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445568 00000100:00100000:1.0:1788797319.739325:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445696 00000100:00100000:1.0:1788797319.739328:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445696 00000100:00100000:1.0:1788797319.739339:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444800 00000100:00100000:1.0:1788797319.739342:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444800 00000100:00100000:1.0:1788797319.739352:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445312 00000100:00100000:1.0:1788797319.739355:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445312 00000100:00100000:1.0:1788797319.739364:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445440 00000100:00100000:1.0:1788797319.739377:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445440 00000100:00100000:1.0:1788797319.739396:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797319.739402:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739434:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390445568:12345-0@lo:400:kworker.0 Request processed in 32us (5131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739439:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797319.739450:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788797319.739456:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875689390445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739494:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875689390445696:12345-0@lo:400:kworker.0 Request processed in 38us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739500:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788797319.739511:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788797319.739517:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390444800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739543:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390444800:12345-0@lo:400:kworker.0 Request processed in 27us (5090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739548:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788797319.739557:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788797319.739563:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390445312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.739585:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390445312:12345-0@lo:400:kworker.0 Request processed in 22us (5106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.739590:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788797319.739775:0:17234:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3616:x1875689390444416:12345-0@lo:400:kworker.0 Request processed in 5039us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797319.739800:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788797319.741189:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788797319.741202:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390445440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797319.741317:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390445440:12345-0@lo:400:kworker.0 Request processed in 120us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797319.741335:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788797319.741370:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788797319.741374:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788797319.741377:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797319.741380:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797319.742743:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c33b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742759:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390445824:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797319.742849:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742861:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742884:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875689390445696:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742911:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390444800:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.742937:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390444928 00000100:00100000:0.0:1788797319.742943:0:20432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390444928 00000100:00100000:0.0:1788797319.742986:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788797319.742995:0:20432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.743211:0:20432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390444928:12345-0@lo:400:kworker.0 Request processed in 216us (8254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797319.743219:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788797319.743241:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445824 00000100:00100000:0.0:1788797319.743245:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445824 00000100:00100000:0.0:1788797319.743278:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788797319.743285:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.743332:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390445824:12345-0@lo:400:kworker.0 Request processed in 47us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797319.743338:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788797319.743368:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390444544:0@lo:400:kworker.0 00000100:00100000:0.0:1788797319.743379:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390445056:0@lo:400:kworker.0 00010000:00080000:0.0:1788797319.743392:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c41b5180 x1875689390445568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797319.743402:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390445568:0@lo:400:kworker.0 00010000:00080000:0.0:1788797319.743432:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c3a00380 x1875689390445824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797319.743439:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390445824:0@lo:400:kworker.0 00000100:00080000:1.0:1788797319.743821:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788797319.746301:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390445440:0@lo:400:kworker.0 00000100:00100000:3.0:1788797319.746330:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390444928:0@lo:400:kworker.0 00000020:01000004:3.0:1788797320.040121:0:20811:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788797320.056076:0:20811:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788797320.056133:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.056148:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.056155:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.056177:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.056201:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788797320.056207:0:20811:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788797320.056240:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797320.056245:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788797320.056251:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788797320.056280:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ff7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788797320.056350:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797320.056357:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797320.056364:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df600 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:0.0:1788797320.056367:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797320.056384:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797320.056391:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797320.056398:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797320.056400:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788797320.056402:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788797320.056428:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797320.056434:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797320.056464:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797320.056471:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021df600/0x6418c0ce308cd9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd9d5 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797320.056494:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797320.056496:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797320.056497:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797320.056506:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797320.056525:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d5a02fe-c590-4f5d-9073-3000c2955450:3617:1875689390446080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797320.056594:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797320.056844:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390445952:0@lo:39:umount.0 00000100:00100000:2.0:1788797320.056879:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797320.056919:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446080 00000100:00100000:2.0:1788797320.056932:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446080 00000100:00100000:2.0:1788797320.057090:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797320.057098:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d5a02fe-c590-4f5d-9073-3000c2955450+24:3617:x1875689390446080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797320.057112:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797320.057128:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3901a00/0x6418c0ce308cd9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cd9ce expref: 24 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797320.057141:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797320.057178:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d5a02fe-c590-4f5d-9073-3000c2955450+23:3617:x1875689390446080:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797320.057184:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797320.057229:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d5a02fe-c590-4f5d-9073-3000c2955450:3617:1875689390446080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797320.057688:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390445952 00000100:00100000:0.0:1788797320.057694:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390445952 00000100:00100000:0.0:1788797320.057895:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797320.057903:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875689390445952:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788797320.057936:0:17242:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd9ff 00000100:00080000:0.0:1788797320.057944:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ffb800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788797320.058016:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3615:x1875689390445952:12345-0@lo:39:umount.0 Request processed in 114us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797320.058022:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1788797320.058029:0:17242:0:(genops.c:885:class_export_put()) final put ffff9a22c2ffa800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788797320.058060:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788797320.058070:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ffa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788797320.058112:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ffb800 for lustre-MDT0000 00000100:00080000:0.0:1788797320.059550:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ff7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788797320.059577:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390445952:0@lo:39:umount.0 00000100:00080000:3.0:1788797320.059932:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797320.059937:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788797320.059942:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788797320.061546:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061564:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061571:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061579:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061608:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797320.061614:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061633:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061639:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061645:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061661:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797320.061675:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797320.061680:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061688:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de200 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797320.061691:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061700:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797320.061706:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797320.061909:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797320.061912:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788797320.061942:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061959:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797320.061986:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.061994:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021de200/0x6418c0ce308cd91f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd926 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062009:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797320.062012:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062017:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515400 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797320.062020:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062027:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797320.062033:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797320.062038:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797320.062040:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788797320.062042:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788797320.062057:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062063:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797320.062077:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062092:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401515400/0x6418c0ce308cdd2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd32 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062101:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.062103:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.062105:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797320.062115:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797320.062133:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390446208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797320.062196:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797320.062250:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446208 00000100:00100000:3.0:1788797320.062256:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446208 00000100:00100000:3.0:1788797320.062311:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797320.062321:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d5a02fe-c590-4f5d-9073-3000c2955450+23:3616:x1875689390446208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797320.062336:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797320.062350:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3900000/0x6418c0ce308cd926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cd91f expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062361:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797320.062395:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d5a02fe-c590-4f5d-9073-3000c2955450+22:3616:x1875689390446208:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797320.062402:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797320.062437:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390446208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797320.062463:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062472:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062496:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062503:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062515:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797320.062524:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797320.062528:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062534:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b600 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797320.062537:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062544:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797320.062550:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797320.062556:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788797320.062558:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788797320.062560:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788797320.062572:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062578:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797320.062584:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062596:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084b600/0x6418c0ce308cded6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdedd expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062605:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.062607:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.062608:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.062617:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062625:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062631:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062637:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062649:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788797320.062653:0:20811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788797320.062656:0:20811:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788797320.062682:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797320.062686:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062691:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de000 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797320.062694:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.062724:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797320.062732:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797320.062737:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797320.062740:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788797320.062742:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788797320.062756:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797320.062887:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390446464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797320.062922:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797320.062951:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797320.062957:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390446336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797320.062979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797320.063005:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446464 00000100:00100000:1.0:1788797320.063009:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446464 00000100:00100000:1.0:1788797320.063038:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446336 00000100:00100000:1.0:1788797320.063041:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446336 00000100:00100000:1.0:1788797320.063057:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788797320.063063:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240170e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+23:3619:x1875689390446464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797320.063073:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797320.063082:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9400/0x6418c0ce308cdedd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cded6 expref: 23 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797320.063092:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797320.063120:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240170e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+22:3619:x1875689390446464:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797320.063127:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788797320.063164:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797320.063169:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+21:3619:x1875689390446336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797320.063187:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797320.063196:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c12e5400/0x6418c0ce308cdd32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdd2b expref: 21 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797320.063205:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797320.063226:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+20:3619:x1875689390446336:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797320.063232:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797320.063261:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390446336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797320.063268:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390446464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797320.063283:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.064219:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797320.064244:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.064253:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021de000/0x6418c0ce308cd911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cd918 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797320.064270:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.064272:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797320.064274:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788797320.064312:0:20811:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788797320.064316:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788797320.064321:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797320.064327:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788797320.064333:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a22c2ce2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797320.064339:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a23c4152800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797320.064343:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a23ec649000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797320.064358:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a23c3628000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797320.064366:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9a22c327b000 37223492-d87c-454e-b62e-aca3f82fa82c 192.168.202.33@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788797320.064371:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9a22c4396800 e2d316d7-5091-401b-8a2a-4413c2cfe0af 192.168.202.33@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1788797320.064376:0:20811:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9a23efa84d40) has exports, disconnecting them 00000020:00080000:3.0:1788797320.064380:0:20811:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a22c2ce2800), last request at 1788797319 00000020:00000080:3.0:1788797320.064387:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdcfa 00000100:00080000:3.0:1788797320.064409:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788797320.064455:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c2ce2800): rc 0 00000020:00000080:3.0:1788797320.064457:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788797320.064469:0:20811:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a23c4152800), last request at 1788797319 00000020:00000080:3.0:1788797320.064472:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdb9c 00000100:00080000:3.0:1788797320.064492:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a23c4154000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788797320.064507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788797320.064552:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ce6800 for lustre-MDT0000 00010000:00010000:3.0:1788797320.064564:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788797320.064572:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23c4152800): rc 0 00000020:00000080:3.0:1788797320.064574:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23c4152800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788797320.064581:0:20811:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a23ec649000), last request at 1788797242 00000020:00000080:3.0:1788797320.064584:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdaed 00000100:00080000:3.0:1788797320.064588:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a23ec649800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788797320.064607:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c4152800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788797320.064630:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c4154000 for lustre-MDT0000 00010000:00010000:3.0:1788797320.064638:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788797320.064645:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23ec649000): rc 0 00000020:00000080:3.0:1788797320.064647:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec649000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788797320.064654:0:20811:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a23c3628000), last request at 1788797241 00000020:00000080:3.0:1788797320.064665:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda92 00000100:00080000:3.0:1788797320.064669:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a23f91db800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788797320.064680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec649000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788797320.064717:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23ec649800 for lustre-MDT0000 00010000:00010000:3.0:1788797320.064726:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788797320.064733:0:20811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:1.0:1788797320.064881:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390446592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797320.064936:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797320.064977:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797320.064988:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446592 00000100:00100000:1.0:1788797320.064994:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446592 00000100:00100000:1.0:1788797320.065034:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797320.065042:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+20:3616:x1875689390446592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797320.065054:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797320.065069:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3900800/0x6418c0ce308cd918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cd911 expref: 20 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797320.065081:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797320.065111:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d5a02fe-c590-4f5d-9073-3000c2955450+19:3616:x1875689390446592:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797320.065116:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797320.065163:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390446592:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788797320.074276:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23c3628000): rc 0 00000004:00000080:3.0:1788797320.074298:0:20811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa529885dbae0 00000100:00080000:3.0:1788797320.074319:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788797320.074324:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000001:00100000:1.0:1788797320.076477:0:17220:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37223492-d87c-454e-b62e-aca3f82fa82c 00000001:00080000:1.0:1788797320.076492:0:17220:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788797320.076497:0:17220:0:(genops.c:885:class_export_put()) final put ffff9a22c327b000/37223492-d87c-454e-b62e-aca3f82fa82c 00000001:00100000:1.0:1788797320.076532:0:17220:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000001:00080000:1.0:1788797320.076537:0:17220:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1788797320.076543:0:17220:0:(genops.c:885:class_export_put()) final put ffff9a22c4396800/e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:0.0:1788797320.076579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c327b000/37223492-d87c-454e-b62e-aca3f82fa82c for lustre-MDT0000 00000020:00000080:0.0:1788797320.076652:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4396800/e2d316d7-5091-401b-8a2a-4413c2cfe0af for lustre-MDT0000 00000020:00000080:0.0:1788797320.076681:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c327d000 for lustre-MDT0000 00000020:00000080:0.0:1788797320.076687:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4393000 for lustre-MDT0000 00000100:00080000:3.0:1788797320.077027:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788797320.077058:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a240097f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788797320.077146:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446720:0@lo:39:umount.0 00000100:00100000:0.0:1788797320.077225:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797320.077307:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446720 00000100:00100000:0.0:1788797320.077316:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446720 00000100:00100000:0.0:1788797320.077363:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797320.077371:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875689390446720:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788797320.077398:0:17246:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdb17 00000100:00080000:0.0:1788797320.077407:0:17246:0:(import.c:65:import_set_state_nolock()) ffff9a22c3be6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788797320.077430:0:17246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788797320.078023:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3615:x1875689390446720:12345-0@lo:39:umount.0 Request processed in 650us (797us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788797320.078044:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1788797320.078074:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788797320.078102:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a240097f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788797320.078109:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446720:0@lo:39:umount.0 00000100:00080000:3.0:1788797320.078873:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788797320.078878:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788797320.078898:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788797320.078963:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788797320.078981:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a240097b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788797320.078992:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788797320.078994:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788797320.079007:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788797320.079062:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788797320.079069:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a23f246b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788797320.079119:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9a23efa84d40) has no exports 00000100:00100000:0.0:1788797320.079495:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446848:0@lo:9:umount.0 00000100:00100000:0.0:1788797320.079547:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797320.079585:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446976:0@lo:9:umount.0 00000100:00100000:0.0:1788797320.079612:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797320.079730:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446848 00000100:00100000:2.0:1788797320.079738:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446848 00000100:00100000:2.0:1788797320.079826:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390446976 00000100:00100000:2.0:1788797320.079830:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390446976 00000100:00100000:2.0:1788797320.079852:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797320.079862:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875689390446848:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788797320.079889:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdbe2 00000100:00080000:2.0:1788797320.079897:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a2400902000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788797320.079935:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788797320.080058:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3615:x1875689390446848:12345-0@lo:9:umount.0 Request processed in 197us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797320.080065:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797320.080079:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788797320.080085:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875689390446976:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788797320.080095:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdd39 00000100:00080000:2.0:1788797320.080110:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788797320.080130:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788797320.080198:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3615:x1875689390446976:12345-0@lo:9:umount.0 Request processed in 113us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797320.080204:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1788797320.080354:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797320.080361:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797320.080386:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a240097b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788797320.080397:0:3615:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788797320.080398:0:3615:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788797320.080402:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446848:0@lo:9:umount.0 00000100:00080000:2.0:1788797320.080411:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f246b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788797320.080417:0:3615:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788797320.080418:0:3615:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788797320.080420:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390446976:0@lo:9:umount.0 00000001:00100000:0.0:1788797320.089518:0:19560:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788797320.089527:0:19560:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce5800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788797320.089554:0:19560:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:0.0:1788797320.089556:0:19560:0:(genops.c:885:class_export_put()) final put ffff9a22c4146000/e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:3.0:1788797320.089609:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788797320.089656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4146000/e2d316d7-5091-401b-8a2a-4413c2cfe0af for lustre-OST0001 00000020:00000080:3.0:1788797320.089673:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ce3800 for lustre-OST0001 00000020:00000080:3.0:1788797320.089678:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4144000 for lustre-OST0001 00000001:00100000:0.0:1788797320.090374:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788797320.090386:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788797320.090390:0:17973:0:(genops.c:885:class_export_put()) final put ffff9a22c3be4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788797320.090407:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 37223492-d87c-454e-b62e-aca3f82fa82c 00000001:00080000:0.0:1788797320.090411:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788797320.090413:0:17973:0:(genops.c:885:class_export_put()) final put ffff9a22c327a000/37223492-d87c-454e-b62e-aca3f82fa82c 00000001:00100000:0.0:1788797320.090417:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000001:00080000:0.0:1788797320.090422:0:17973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788797320.090424:0:17973:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce0000/e2d316d7-5091-401b-8a2a-4413c2cfe0af 00000020:00000080:1.0:1788797320.090461:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3be4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788797320.090518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c327a000/37223492-d87c-454e-b62e-aca3f82fa82c for lustre-MDT0001 00000020:00000080:1.0:1788797320.090550:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce0000/e2d316d7-5091-401b-8a2a-4413c2cfe0af for lustre-MDT0001 00000020:00000080:1.0:1788797320.090572:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c3be6000 for lustre-MDT0001 00000020:00000080:1.0:1788797320.090576:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c3279800 for lustre-MDT0001 00000020:00000080:1.0:1788797320.090579:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4391000 for lustre-MDT0001 00000020:00080000:3.0:1788797320.091196:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9a23efa84d40) has no exports 00000020:00000080:3.0:1788797320.157224:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd96c 00000020:00000080:3.0:1788797320.157241:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a2400978800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788797320.157262:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788797320.157370:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a2400978800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788797320.157551:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797320.157561:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797320.157566:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9a22c3193380) has no exports 00000020:00000080:2.0:1788797320.158158:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd965 00000020:00000080:2.0:1788797320.158166:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23d14a5800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788797320.158211:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797320.158218:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788797320.158220:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23f2a62800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788797320.158222:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23f2a62800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788797320.158229:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788797320.158402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23d14a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788797320.306983:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797321.331241:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797321.780413:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797321.785477:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390447104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797321.785557:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797321.786080:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447104 00000100:00100000:3.0:1788797321.786090:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447104 00000100:00100000:3.0:1788797321.786167:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797321.786177:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390447104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788797321.786209:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788797321.786287:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390447104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797321.786294:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788797321.786430:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390447104:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788797321.787229:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788797322.358379:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797322.803228:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390447232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797322.803331:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797322.803579:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447232 00000100:00100000:3.0:1788797322.803589:0:18750:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447232 00000100:00100000:3.0:1788797322.803668:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797322.803688:0:18750:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390447232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788797322.803719:0:18750:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788797322.803873:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797322.803964:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390447232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797322.804176:0:18750:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390447232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797322.804185:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788797323.378949:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797323.828661:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390447360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797323.828734:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797323.828891:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447360 00000100:00100000:3.0:1788797323.828900:0:17245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447360 00000100:00100000:3.0:1788797323.828953:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788797323.828961:0:17245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875689390447360:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788797323.828967:0:17245:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788797323.829017:0:17245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875689390447360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (283us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788797323.829024:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:02020000:2.0:1788797323.829288:0:3619:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788797323.833090:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788797323.833101:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797323.833105:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788797323.861942:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797323.861956:0:3619:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1788797323.861975:0:3619:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a23c362c800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797323.862022:0:3619:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23fa762a00 x1875689390447488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797323.862320:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390447488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788797323.862401:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797323.863013:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447488 00000100:00100000:2.0:1788797323.863022:0:20432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447488 00000100:00100000:2.0:1788797323.864767:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788797323.864783:0:20432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1875689390447488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788797323.864820:0:20432:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788797323.875959:0:20432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3615:x1875689390447488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 11170us (13549us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797323.875975:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788797323.876030:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797323.876046:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797323.876051:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390447488:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:2.0:1788797324.083529:0:17994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797324.405890:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797324.851348:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797324.851371:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788797324.851376:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797324.851384:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1788797324.851390:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797324.851402:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a23c362c800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797324.851430:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d9b100 x1875689390447744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797324.851581:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390447744:0@lo:38:kworker.0 00000100:00100000:2.0:1788797324.851640:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390447616:0@lo:400:kworker.0 00000100:00100000:1.0:1788797324.851668:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.851682:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.851738:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.851770:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.851834:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788797324.851841:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390447872:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.851865:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.851884:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390448384:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.851903:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.851935:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447872 00000100:00100000:2.0:1788797324.851942:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447872 00000100:00100000:2.0:1788797324.851993:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788797324.852005:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390447872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852053:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390447872:12345-0@lo:400:kworker.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797324.852060:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788797324.852098:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390447872:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852122:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390448128:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852143:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.852160:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390448640:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852177:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.852194:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788797324.852200:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390448000:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852220:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797324.852236:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390448512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852267:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788797324.852303:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797324.852317:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448256 00000100:00100000:2.0:1788797324.852326:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448256 00000100:00100000:2.0:1788797324.852342:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448384 00000100:00100000:2.0:1788797324.852345:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448384 00000100:00100000:2.0:1788797324.852364:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448128 00000100:00100000:2.0:1788797324.852366:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448128 00000100:00100000:2.0:1788797324.852373:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448640 00000100:00100000:2.0:1788797324.852375:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448640 00000100:00100000:2.0:1788797324.852387:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448512 00000100:00100000:2.0:1788797324.852389:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448512 00000100:00100000:2.0:1788797324.852399:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788797324.852406:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390448384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852442:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390448384:12345-0@lo:400:kworker.0 Request processed in 37us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797324.852449:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788797324.852461:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788797324.852468:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390448640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852497:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390448640:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797324.852503:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788797324.852514:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788797324.852519:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875689390448256:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788797324.852524:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788797324.852547:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875689390448256:12345-0@lo:400:kworker.0 Request processed in 27us (776us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788797324.852552:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788797324.852563:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788797324.852567:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875689390448128:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788797324.852570:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788797324.852599:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875689390448128:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788797324.852605:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788797324.852616:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788797324.852620:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875689390448512:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788797324.852624:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788797324.852644:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875689390448512:12345-0@lo:400:kworker.0 Request processed in 22us (376us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788797324.852649:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788797324.852665:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788797324.852681:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c1ce9f80 x1875689390448384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797324.852691:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390448384:0@lo:400:kworker.0 00000100:00080000:2.0:1788797324.852701:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788797324.852705:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797324.852709:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788797324.852714:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797324.852717:0:3616:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1788797324.852723:0:3616:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a23c4166000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797324.852753:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23fa762a00 x1875689390448768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797324.852767:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390448256:0@lo:400:kworker.0 00000100:00080000:2.0:1788797324.852818:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788797324.852821:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797324.852824:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788797324.852832:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797324.852835:0:3619:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788797324.852841:0:3619:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a22c4390000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797324.852853:0:3619:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c1ce9f80 x1875689390448896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797324.852864:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390448512:0@lo:400:kworker.0 00000100:00080000:2.0:1788797324.852874:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788797324.852876:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797324.852878:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788797324.852881:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797324.852883:0:3619:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:2.0:1788797324.852887:0:3619:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a22c3a75000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797324.852896:0:3619:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d98e00 x1875689390449024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797324.852903:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390448128:0@lo:400:kworker.0 00010000:00080000:2.0:1788797324.852911:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23d89e5f80 x1875689390448640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797324.852918:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390448640:0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.852951:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448000 00000100:00100000:2.0:1788797324.852955:0:18748:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448000 00000100:00100000:2.0:1788797324.852985:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788797324.852992:0:18748:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390448000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797324.853028:0:18748:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390448000:12345-0@lo:400:kworker.0 Request processed in 37us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797324.853040:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788797324.853054:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797324.853072:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788797324.853421:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447616 00000100:00100000:0.0:1788797324.853426:0:17235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447616 00000100:00100000:0.0:1788797324.853468:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788797324.853474:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d5a02fe-c590-4f5d-9073-3000c2955450+19:3616:x1875689390447616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797324.853517:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d5a02fe-c590-4f5d-9073-3000c2955450+19:3616:x1875689390447616:12345-0@lo:400:kworker.0 Request processed in 43us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797324.853523:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788797324.853565:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390447616:0@lo:400:kworker.0 00000100:00100000:3.0:1788797324.853647:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390447744 00000100:00100000:3.0:1788797324.853651:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390447744 00000100:00100000:3.0:1788797324.853680:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788797324.853685:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390447744:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788797324.853698:0:17246:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788797324.860109:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390448768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788797324.860195:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797324.860250:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390448896:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788797324.860275:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797324.860295:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390449024:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788797324.860314:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797324.860372:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448768 00000100:00100000:1.0:1788797324.860381:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448768 00000100:00100000:1.0:1788797324.860411:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390448896 00000100:00100000:1.0:1788797324.860414:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390448896 00000100:00100000:1.0:1788797324.860422:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449024 00000100:00100000:1.0:1788797324.860424:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449024 00000100:00100000:1.0:1788797324.860436:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788797324.860442:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3615:x1875689390448768:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788797324.860459:0:20378:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788797324.860502:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3615:x1875689390448768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 59us (307us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788797324.860509:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788797324.860571:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788797324.860577:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875689390448896:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788797324.860587:0:17241:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788797324.860617:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875689390448896:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 39us (342us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797324.860623:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788797324.860636:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788797324.860640:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875689390449024:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788797324.860647:0:17241:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788797324.860667:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875689390449024:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26us (353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797324.860672:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788797324.860748:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797324.860753:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797324.860757:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390448768:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788797324.860766:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797324.860769:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797324.860772:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390448896:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788797324.860779:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797324.860782:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797324.860784:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390449024:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788797324.865909:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390447744:12345-0@lo:38:kworker.0 Request processed in 12215us (14249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788797324.865923:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788797324.869049:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797324.869063:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797324.869068:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390447744:0@lo:38:kworker.0 00010000:00010000:2.0:1788797325.427421:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788797325.889904:0:17220:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788797325.889917:0:17220:0:(genops.c:885:class_export_put()) final put ffff9a23c3628000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788797325.890051:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c3628000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788797325.890121:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23f91db800 for lustre-MDT0000 00000020:01000000:2.0:1788797326.194944:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c3048060 - data ffff9a22c185dd80/ffff9a22c1edc400 00000020:01000000:2.0:1788797326.195076:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c239bd20 - data ffff9a23eac32948/ffff9a23fc69b000 00000001:00000004:2.0:1788797326.204888:0:20811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1788797326.267206:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788797326.267215:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788797326.267242:0:20811:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a22c2d98380 x1875689390446720/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788797330 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797326.267266:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788797326.269395:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788797326.269403:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788797326.269754:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797326.269758:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788797326.270582:0:17264:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788797326.270589:0:17264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788797326.270599:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788797326.271267:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788797326.271285:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788797326.271337:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797326.271339:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788797326.272245:0:17266:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788797326.272251:0:17266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788797326.272271:0:17266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788797326.275590:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd934 00000020:00000080:3.0:1788797326.275605:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788797326.279356:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd949 00000020:00000080:3.0:1788797326.279370:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec64e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797326.279547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788797326.282320:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788797326.282332:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.282345:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788797326.282351:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9a23efa83380) has no exports 00000004:01000000:3.0:1788797326.282551:0:20811:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788797326.282562:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd9ab 00000020:00000080:3.0:1788797326.282574:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23f2469800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788797326.282579:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788797326.282583:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.282587:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797326.282590:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9a23f2af8000) has no exports 00000020:00000080:3.0:1788797326.282597:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd9a4 00000020:00000080:3.0:1788797326.282601:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23f2468800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788797326.283007:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788797326.283013:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788797326.283017:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788797326.283025:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797326.283028:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788797326.283065:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.283071:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797326.283077:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd996 00000020:00000080:3.0:1788797326.283082:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23f246b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788797326.283086:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788797326.283089:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.283092:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797326.283094:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9a2400984d40) has no exports 00000020:00000080:3.0:1788797326.283109:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd98f 00000020:00000080:3.0:1788797326.283111:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a240097f000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788797326.283581:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788797326.283585:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788797326.283588:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788797326.283591:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797326.283593:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788797326.283614:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.283619:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788797326.283628:0:20811:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788797326.283633:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd981 00000020:00000080:3.0:1788797326.283637:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23cb177800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788797326.283641:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788797326.283645:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.283648:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797326.283651:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9a2400983380) has no exports 00000020:00000080:3.0:1788797326.283654:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd97a 00000020:00000080:3.0:1788797326.283657:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a240097c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788797326.283930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec64e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788797326.283941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23f2469800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788797326.283948:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23f2468800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788797326.283953:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23f246b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788797326.283959:0:36:0:(genops.c:885:class_export_put()) final put ffff9a23f246a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797326.283961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23f246a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788797326.283966:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788797326.284046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23f246b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788797326.284051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240097f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788797326.284055:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a240097b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788797326.284058:0:36:0:(genops.c:885:class_export_put()) final put ffff9a23cb171000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797326.284060:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23cb171000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788797326.284064:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788797326.284091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23cb177800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788797326.284095:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240097c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788797326.304468:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788797326.304479:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788797326.304484:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788797326.304492:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788797326.304590:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.304602:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797326.304631:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.304635:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797326.304640:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788797326.304645:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788797326.304656:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797326.304763:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd950 00000020:00000080:3.0:1788797326.304770:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec64b000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788797326.310924:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a240097f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788797326.310943:0:36:0:(genops.c:885:class_export_put()) final put ffff9a240097e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788797326.310946:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240097e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788797326.310958:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788797326.311407:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788797326.311424:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.311434:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788797326.311439:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9a23efa819c0) has no exports 00000020:00000080:3.0:1788797326.311470:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.311476:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788797326.311483:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd957 00000020:00000080:3.0:1788797326.311490:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec64a000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788797326.311500:0:20811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23d01e5000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788797326.311504:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23d01e5000 3 00000020:01000004:3.0:1788797326.311507:0:20811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a23d01e5000 from lustre-MDT0000 00000020:00000080:3.0:1788797326.311539:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.311543:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788797326.311547:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff1800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788797326.311550:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788797326.311558:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788797326.311609:0:20811:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788797326.311613:0:20811:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788797326.311616:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788797326.311619:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797326.311623:0:20811:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788797326.311629:0:20811:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9a23ff5ab800 3d5a02fe-c590-4f5d-9073-3000c2955450 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788797326.311634:0:20811:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9a22c3194d40) has exports, disconnecting them 00000020:00080000:3.0:1788797326.311639:0:20811:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a23ff5ab800), last request at 1788797226 00000020:00000080:3.0:1788797326.311654:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd8fc 00000020:00010000:3.0:1788797326.311658:0:20811:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a23ff5ab800: total 2 00000100:00080000:3.0:1788797326.311664:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9a23ff5af000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788797326.311735:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec64b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788797326.311740:0:36:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff5800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788797326.311742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788797326.311746:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788797326.311804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec64a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1788797326.314444:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23ff5ab800): rc 0 00000020:00080000:3.0:1788797326.314458:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9a22c3194d40) has no exports 00000100:00100000:1.0:1788797326.314651:0:17236:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a23eb3a4e00:17236] 2 exiting: rc = 0 00000100:00100000:1.0:1788797326.314813:0:17235:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a23eb3a4a00:17235] 1 exiting: rc = 0 00000100:00100000:2.0:1788797326.315290:0:17234:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a240093a800:17234] 0 exiting: rc = 1 00000020:00010000:0.0:1788797326.315308:0:17229:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a23ff5ab800: total 0 00010000:00010000:0.0:1788797326.315370:0:17229:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a23ff5ab800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788797326.315404:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a24021dfa00/0x6418c0ce308cdb5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdb56 expref: 14 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315422:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084ba00/0x6418c0ce308cdcbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdcb4 expref: 13 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315684:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3901000/0x6418c0ce308cda1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cda14 expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315700:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084a400/0x6418c0ce308cdeb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdeac expref: 11 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315711:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084a800/0x6418c0ce308cdad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdad1 expref: 10 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315720:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3900600/0x6418c0ce308cda29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cda22 expref: 9 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315825:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308cdec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdeba expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315836:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c12e4a00/0x6418c0ce308cda37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cda30 expref: 7 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315847:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9000/0x6418c0ce308cdce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdcde expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315856:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3901800/0x6418c0ce308cd90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cd903 expref: 5 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315867:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308cdd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdd1d expref: 4 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315878:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3901400/0x6418c0ce308cdb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdb80 expref: 3 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315902:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e8200/0x6418c0ce308cdecf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6418c0ce308cdec8 expref: 2 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797326.315911:0:17229:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a23ff5ab800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788797326.315927:0:17229:0:(genops.c:885:class_export_put()) final put ffff9a23ff5ab800/3d5a02fe-c590-4f5d-9073-3000c2955450 00010000:00010000:0.0:1788797326.315942:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797326.315944:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797326.315946:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788797326.316038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ff5ab800/3d5a02fe-c590-4f5d-9073-3000c2955450 for MGS 00000020:00000080:0.0:1788797326.316079:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23ff5af000 for MGS 00000100:00100000:1.0:1788797326.316725:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316735:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316741:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316746:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316751:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316758:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316765:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316771:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316776:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316783:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316805:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316812:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316818:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316824:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316830:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316837:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316843:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316848:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316855:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316862:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316868:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316887:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316893:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316898:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316904:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316910:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316915:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316921:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316929:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316934:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316939:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316944:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316951:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316959:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316964:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316969:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316974:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316979:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316983:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316987:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316992:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.316997:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317003:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317008:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317012:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317017:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317022:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317027:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317033:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317037:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317041:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317046:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317052:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317057:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317061:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317066:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317079:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317084:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317089:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317095:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317100:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317104:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317110:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797326.317115:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788797326.322290:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c3048540 - data ffff9a23eaf580d8/ffff9a22c1edc800 00000020:01000000:1.0:1788797326.323173:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c239b840 - data ffff9a23eacaf870/ffff9a23fba0c800 00000020:00000080:1.0:1788797326.323654:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd8e0 00000020:00000080:1.0:1788797326.323665:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c3b2d800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788797326.324177:0:20811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23d01e5000 from MGS, refs=2 00000020:01000004:1.0:1788797326.324182:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23d01e5000 2 00000020:01000004:1.0:1788797326.324185:0:20811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a23d01e5000 from MGS 00000020:00000080:1.0:1788797326.324221:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797326.324238:0:20811:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788797326.324242:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c3b2d000/MGS 00000020:00000080:1.0:1788797326.324244:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3b2d000/MGS for MGS 00000020:01000000:1.0:1788797326.324253:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788797326.324327:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788797326.324331:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797326.324337:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788797326.324344:0:20811:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a23ec64f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797326.324350:0:20811:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9a23f241b380) has exports, disconnecting them 00000020:00080000:1.0:1788797326.324355:0:20811:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a23ec64f000), last request at 1788797226 00000020:00000080:1.0:1788797326.324359:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd9e3 00000020:00080000:1.0:1788797326.324370:0:20811:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23ec64f000): rc 0 00000020:00000080:1.0:1788797326.324374:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec64f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788797326.324729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3b2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788797326.327191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec64f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788797326.329875:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788797326.329885:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797326.329890:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797326.329898:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797326.330098:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797326.330142:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ff7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788797326.330248:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788797326.330255:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23ec648000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788797326.330259:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ec648000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788797326.330265:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788797326.330345:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23d01e5000 1 00000020:00000080:0.0:1788797326.330351:0:20811:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd8d2 00000020:00000080:0.0:1788797326.330357:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a22c3b2a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788797326.330372:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788797326.330376:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797326.330380:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788797326.330384:0:20811:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9a23efa80000) has no exports 00000020:00000080:3.0:1788797326.331278:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3b2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1788797326.393888:0:18743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788797326.393899:0:18743:0:(genops.c:885:class_export_put()) final put ffff9a2400901000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788797326.397058:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a2400901000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788797326.397116:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a2400902000 for lustre-OST0000 00000020:00000080:1.0:1788797326.466833:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797326.466846:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788797326.466852:0:20811:0:(genops.c:885:class_export_put()) final put ffff9a23d01e1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788797326.466865:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23d01e1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788797326.466876:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788797326.467320:0:20811:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a23d01e6000 00000020:02000400:1.0:1788797326.467383:0:20811:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788797326.527254:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797326.900206:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390449152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797326.900290:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797326.900476:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449152 00000100:00100000:1.0:1788797326.900486:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449152 00000100:00100000:1.0:1788797326.900561:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788797326.900571:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390449152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788797326.900600:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797326.900653:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390449152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797326.900660:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788797326.900720:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797326.900750:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390449152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788797327.546457:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797327.926038:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797327.926072:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390449280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797327.926167:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797327.926424:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449280 00000100:00100000:1.0:1788797327.926436:0:18751:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449280 00000100:00100000:1.0:1788797327.926523:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788797327.926539:0:18751:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390449280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797327.926570:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797327.926616:0:18751:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390449280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797327.926629:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788797327.926677:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390449280:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788797327.926752:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788797328.567368:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797329.587132:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797329.976311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788797329.976317:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788797329.976321:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797329.976327:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:1.0:1788797329.976331:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788797329.976351:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a23c362c800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797329.976363:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797329.976376:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390449408:0@lo:400:kworker.0 00000400:00000100:1.0:1788797329.976415:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689390449408 offset 0 length 224: 4 00000100:00100000:1.0:1788797329.976465:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c40c3800 x1875689390449536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797329.976492:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390449536:0@lo:38:kworker.0 00000100:00100000:1.0:1788797329.976516:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797329.976542:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449536 00000100:00100000:1.0:1788797329.976548:0:17245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449536 00000100:00100000:1.0:1788797329.976571:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788797329.976576:0:17245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390449536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788797329.976592:0:17245:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797329.989006:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797329.989031:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390449664:0@lo:400:kworker.0 00000100:00100000:0.0:1788797329.989099:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788797329.990552:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797329.990558:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788797329.990563:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797329.990570:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1788797329.990575:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788797329.990586:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a22c3a75000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797329.990616:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c42b3800 x1875689390449920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797329.990646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797329.990650:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788797329.990652:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797329.990655:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1788797329.990658:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788797329.990663:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a23c4166000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797329.990675:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c42b1180 x1875689390450048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797329.990692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797329.990708:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788797329.990710:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797329.990714:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1788797329.990716:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788797329.990721:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a22c4390000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797329.990735:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c42b1880 x1875689390450304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797329.990769:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390450432:0@lo:400:kworker.0 00000100:00100000:0.0:1788797329.990835:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797329.990881:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450432 00000100:00100000:0.0:1788797329.990900:0:17241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450432 00000100:00100000:0.0:1788797329.990952:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788797329.990961:0:17241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390450432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797329.991009:0:17241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390450432:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797329.991016:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788797329.991054:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a22c42b3100 x1875689390450432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797329.991066:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390450432:0@lo:400:kworker.0 00000100:00100000:3.0:1788797329.991146:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390450176:0@lo:400:kworker.0 00000100:00100000:3.0:1788797329.991175:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797329.991209:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797329.991216:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390449792:0@lo:400:kworker.0 00000100:00100000:3.0:1788797329.991246:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797329.991300:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450176 00000100:00100000:0.0:1788797329.991305:0:17240:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450176 00000100:00100000:0.0:1788797329.991374:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788797329.991382:0:17240:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390450176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797329.991422:0:17240:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390450176:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797329.991442:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788797329.992079:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449664 00000100:00100000:2.0:1788797329.992085:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449664 00000100:00100000:2.0:1788797329.992115:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449792 00000100:00100000:2.0:1788797329.992118:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449792 00000100:00100000:2.0:1788797329.992139:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788797329.992147:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390449664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797329.992189:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390449664:12345-0@lo:400:kworker.0 Request processed in 44us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797329.992206:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788797329.992219:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788797329.992226:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390449792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797329.992253:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390449792:12345-0@lo:400:kworker.0 Request processed in 28us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797329.992258:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788797329.992273:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797329.992284:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788797329.992287:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788797329.992327:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390449664:0@lo:400:kworker.0 00000100:00100000:3.0:1788797329.995584:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390449792:0@lo:400:kworker.0 00010000:00080000:3.0:1788797329.995607:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a22c42b0000 x1875689390450176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797329.995630:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390450176:0@lo:400:kworker.0 00000100:00100000:0.0:1788797329.995856:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390449920:0@lo:38:kworker.0 00000100:00100000:0.0:1788797329.995931:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797329.995965:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390450048:0@lo:38:kworker.0 00000100:00100000:0.0:1788797329.995987:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797329.996006:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390450304:0@lo:38:kworker.0 00000100:00100000:0.0:1788797329.996028:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797329.996063:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390449920 00000100:00100000:0.0:1788797329.996069:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390449920 00000100:00100000:0.0:1788797329.996099:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450048 00000100:00100000:0.0:1788797329.996102:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450048 00000100:00100000:0.0:1788797329.996111:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450304 00000100:00100000:0.0:1788797329.996113:0:17242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450304 00000100:00100000:0.0:1788797329.996124:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797329.996131:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390449920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788797329.996151:0:17242:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797329.996202:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390449920:12345-0@lo:38:kworker.0 Request processed in 60us (260us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797329.996209:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797329.996225:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797329.996229:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390450048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788797329.996238:0:17242:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797329.996261:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390450048:12345-0@lo:38:kworker.0 Request processed in 30us (272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797329.996266:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797329.996288:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788797329.996293:0:17242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390450304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788797329.996302:0:17242:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797329.996325:0:17242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390450304:12345-0@lo:38:kworker.0 Request processed in 31us (296us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797329.996330:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788797329.996357:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797329.996362:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797329.996365:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390449920:0@lo:38:kworker.0 00000100:00080000:0.0:1788797329.996374:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797329.996377:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797329.996380:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390450048:0@lo:38:kworker.0 00000100:00080000:0.0:1788797329.996387:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797329.996390:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797329.996393:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390450304:0@lo:38:kworker.0 00000100:00100000:1.0:1788797329.997309:0:17245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390449536:12345-0@lo:38:kworker.0 Request processed in 20730us (20790us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788797329.997318:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788797329.997350:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788797329.997353:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788797329.997357:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390449536:0@lo:38:kworker.0 00000020:01000004:1.0:1788797330.212027:0:21012:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788797330.219949:0:21012:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788797330.219997:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.220009:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.220029:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.220033:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.220051:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788797330.220055:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788797330.220077:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797330.220081:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788797330.220087:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797330.220093:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a22c3a75000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788797330.220097:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797330.220099:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788797330.220102:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788797330.220885:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797330.220893:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797330.220901:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5200 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797330.220904:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797330.220910:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797330.220915:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797330.220918:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788797330.220920:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788797330.220922:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788797330.220956:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797330.220960:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797330.220988:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797330.220994:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5200/0x6418c0ce308cdad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdad8 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797330.221008:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797330.221008:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788797330.221020:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797330.221022:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797330.221031:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d5a02fe-c590-4f5d-9073-3000c2955450:3618:1875689390450560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797330.221114:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797330.221304:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450560 00000100:00100000:2.0:1788797330.221312:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450560 00010000:00010000:1.0:1788797330.221500:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221510:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221517:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221525:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221541:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797330.221555:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221560:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797330.221562:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221565:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221568:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221572:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de800 already unused, calling callback (ffffffffc14aec20) 00010000:00010000:1.0:1788797330.221576:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797330.221576:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221589:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797330.221593:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221594:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797330.221601:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221602:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797330.221607:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788797330.221608:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797330.221609:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788797330.221614:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221619:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797330.221622:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221624:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221627:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797330.221630:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221641:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221643:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221648:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221649:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021de800/0x6418c0ce308cda30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda37 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797330.221656:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788797330.221659:0:21012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788797330.221660:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:01000000:1.0:1788797330.221661:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1788797330.221663:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221668:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4400 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:0.0:1788797330.221671:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221676:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788797330.221680:0:21012:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 10000000:00010000:0.0:1788797330.221682:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788797330.221683:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788797330.221687:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1788797330.221691:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000020:00000080:1.0:1788797330.221693:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:01000000:0.0:1788797330.221693:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788797330.221694:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:1.0:1788797330.221697:0:21012:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9a22c3be0000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797330.221703:0:21012:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9a23c4157000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788797330.221705:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788797330.221709:0:21012:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9a22c3190000) has exports, disconnecting them 00010000:00010000:0.0:1788797330.221711:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788797330.221713:0:21012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a22c3be0000), last request at 1788797329 00010000:00010000:0.0:1788797330.221716:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788797330.221719:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdd0f 00010000:00010000:0.0:1788797330.221722:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c12e4400/0x6418c0ce308cdd1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdd24 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788797330.221732:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a22c327f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788797330.221734:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797330.221736:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221741:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514000 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:0.0:1788797330.221744:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221749:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797330.221754:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797330.221759:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788797330.221762:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788797330.221767:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788797330.221780:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221800:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788797330.221812:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221818:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401514000/0x6418c0ce308cdec8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cdecf expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221826:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797330.221828:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221833:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df200 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:0.0:1788797330.221835:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797330.221841:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797330.221846:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797330.221851:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797330.221853:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788797330.221855:0:17229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788797330.221866:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788797330.221867:0:21012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c3be0000): rc 0 00000020:00000080:1.0:1788797330.221870:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c3be0000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1788797330.221871:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788797330.221880:0:21012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a23c4157000), last request at 1788797329 00000020:00000080:1.0:1788797330.221883:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdbb1 00010000:00010000:0.0:1788797330.221883:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788797330.221889:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a23c4154800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788797330.221889:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021df200/0x6418c0ce308cda22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6418c0ce308cda29 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788797330.221894:0:21012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23c4157000): rc 0 00000020:00000080:1.0:1788797330.221896:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c4157000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:0.0:1788797330.221900:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797330.221901:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788797330.221903:0:21012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa52981bebae0 00010000:00010000:0.0:1788797330.221903:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797330.221914:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390450688:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788797330.221924:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797330.221932:0:21012:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a22c1ce2d80 x1875689390447360/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788797339 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797330.221942:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788797330.221944:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788797330.222857:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797330.222863:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1788797330.223165:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450688 00000100:00100000:2.0:1788797330.223173:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450688 00000100:00100000:0.0:1788797330.223209:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797330.223218:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390450816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797330.223225:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797330.223233:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1875689390450560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788797330.223239:0:17227:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797330 with bad export cookie 7212726795044182268 00000100:00100000:0.0:1788797330.223463:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788797330.223555:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3be0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788797330.223605:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c4157000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788797330.223640:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c327f000 for lustre-MDT0001 00000020:00000080:0.0:1788797330.223645:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c4154800 for lustre-MDT0001 00000100:00100000:0.0:1788797330.223730:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390451072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797330.223756:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797330.223771:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390447360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797330.223806:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797330.223812:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390450944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797330.223835:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797330.224845:0:18394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450816 00000100:00100000:1.0:1788797330.224853:0:18394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450816 00000100:00100000:1.0:1788797330.224878:0:18394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390451072 00000100:00100000:1.0:1788797330.224879:0:18394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390451072 00000100:00100000:1.0:1788797330.224883:0:18394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390450944 00000100:00100000:1.0:1788797330.224885:0:18394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390450944 00000100:00100000:1.0:1788797330.224892:0:18394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797330.224897:0:18394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1875689390450688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788797330.224902:0:18394:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797330 with bad export cookie 7212726795044182268 00000100:00100000:1.0:1788797330.224962:0:18394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1875689390450688:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (3017us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788797330.224969:0:18394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797330.224984:0:18394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797330.224988:0:18394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1875689390450816:12345-0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788797330.224988:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00020000:1.0:1788797330.224992:0:18394:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797330 with bad export cookie 7212726795044182268 00000100:00080000:0.0:1788797330.224994:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788797330.224997:0:3616:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.133@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788797330.225013:0:18394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1875689390450816:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (1551us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788797330.225018:0:18394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797330.225045:0:18394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797330.225048:0:18394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3619:x1875689390451072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797330.227009:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:1.0:1788797330.227301:0:18394:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797330 with bad export cookie 7212726795044182268 00000100:00100000:1.0:1788797330.227420:0:18394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3619:x1875689390451072:12345-0@lo:103:ldlm_bl.0 Request processed in 2366us (3659us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788797330.227431:0:18394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797330.227465:0:18394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788797330.227470:0:18394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240170d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3619:x1875689390450944:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788797330.227476:0:18394:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788797330 with bad export cookie 7212726795044182268 00000100:00100000:1.0:1788797330.227501:0:18394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240170d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3619:x1875689390450944:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (3665us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788797330.227506:0:18394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788797330.227581:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788797330.227586:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788797330.227600:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788797330.227680:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788797330.227703:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a23c362d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788797330.227718:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788797330.227721:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788797330.227728:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788797330.227941:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390451200:0@lo:9:umount.0 00000100:00100000:1.0:1788797330.227978:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788797330.228053:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788797330.228063:0:21012:0:(import.c:65:import_set_state_nolock()) ffff9a240162f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788797330.228079:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390451328:0@lo:9:umount.0 00000100:00100000:1.0:1788797330.228103:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788797330.228226:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9a22c3190000) has no exports 00000100:00100000:3.0:1788797330.228426:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390451200 00000100:00100000:3.0:1788797330.228434:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390451200 00000100:00100000:3.0:1788797330.228478:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390451328 00000100:00100000:3.0:1788797330.228481:0:18746:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390451328 00000100:00100000:3.0:1788797330.228503:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797330.228510:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c40c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875689390451200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788797330.228532:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdbdb 00000100:00080000:3.0:1788797330.228543:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a23c4167800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788797330.228582:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788797330.228708:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c40c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3615:x1875689390451200:12345-0@lo:9:umount.0 Request processed in 198us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797330.228725:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797330.228739:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797330.228745:0:18746:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875689390451328:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788797330.228757:0:18746:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdd40 00000100:00080000:3.0:1788797330.228763:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788797330.228824:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788797330.228897:0:18746:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3615:x1875689390451328:12345-0@lo:9:umount.0 Request processed in 152us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797330.228904:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788797330.228940:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a240162f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788797330.228950:0:3615:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788797330.228952:0:3615:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.228955:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390451328:0@lo:9:umount.0 00000100:00080000:3.0:1788797330.228966:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c362d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788797330.228974:0:3615:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788797330.228976:0:3615:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.228978:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390451200:0@lo:9:umount.0 00010000:00010000:3.0:1788797330.229006:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797330.229861:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.133@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788797330.232403:0:3616:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.133@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788797330.232409:0:3616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788797330.232418:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c40c3100 x1875689390449408/t0(0) o400->MGC192.168.202.133@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788797345 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797330.232433:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c2d99f80 x1875689390450560/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797346 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797330.232448:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c42b1180 x1875689390450688/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797346 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797330.232457:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c42b3800 x1875689390450816/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797346 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797330.232465:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23fa762a00 x1875689390451072/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797346 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797330.232474:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c42b3100 x1875689390450944/t0(0) o103->MGC192.168.202.133@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788797346 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788797330.232547:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788797330.232550:0:3616:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788797330.232552:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788797330.232691:0:3619:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a22c40b7000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788797330.232691:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797330.232696:0:3616:0:(import.c:545:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 485 00000100:00080000:0.0:1788797330.232709:0:3616:0:(import.c:666:import_select_connection()) MGC192.168.202.133@tcp: import ffff9a22c40b7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797330.232712:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390451072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797330.232725:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d5a02fe-c590-4f5d-9073-3000c2955450:3618:1875689390450560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797330.232735:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c40c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390449408:0@lo:400:kworker.0 00000100:00100000:1.0:1788797330.232748:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d5a02fe-c590-4f5d-9073-3000c2955450:3619:1875689390450944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797330.232755:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797330.232874:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c41b4380 x1875689390451456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797330.232907:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390450816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788797330.232912:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d5a02fe-c590-4f5d-9073-3000c2955450:3616:1875689390450688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797330.233972:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390451456:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788797330.234023:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689390451456 offset 0 length 520: 4 00000400:00000100:2.0:1788797330.238265:0:17227:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875689390450560 offset 224 length 224: 4 00000100:00100000:2.0:1788797330.238289:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1875689390450560:12345-0@lo:103:ldlm_bl.0 Request processed in 15056us (17174us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788797330.238297:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:3.0:1788797330.250262:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9a22c3190000) has no exports 00000020:01000000:2.0:1788797330.302421:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c3048ae0 - data ffff9a22c1913af8/ffff9a22c1edc000 00000020:01000000:2.0:1788797330.302602:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a24014daa80 - data ffff9a23e039ae58/ffff9a23fa678400 00000001:00000004:2.0:1788797330.311507:0:21012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788797330.355020:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788797330.355032:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788797330.355039:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788797330.356289:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788797330.356294:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788797330.356887:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.356891:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788797330.357290:0:17981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788797330.357295:0:17981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788797330.357306:0:17981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788797330.358020:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788797330.358024:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788797330.358087:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.358091:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788797330.358315:0:17983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788797330.358319:0:17983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788797330.358327:0:17983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788797330.359357:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda45 00000020:00000080:3.0:1788797330.359367:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c362a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788797330.360124:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda5a 00000020:00000080:3.0:1788797330.360131:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c362a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.360169:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c362a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788797330.360235:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788797330.360241:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797330.360249:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788797330.360253:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9a22c31919c0) has no exports 00000004:01000000:3.0:1788797330.360394:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788797330.360401:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdaae 00000020:00000080:3.0:1788797330.360405:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c3be1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.360422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c362a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788797330.360474:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788797330.360478:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797330.360482:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797330.360485:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9a23c41b4d40) has no exports 00000020:00000080:3.0:1788797330.360489:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdaa7 00000020:00000080:3.0:1788797330.360492:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a240162d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788797330.360508:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3be1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1788797330.360912:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788797330.360916:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788797330.360920:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788797330.360926:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.360928:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788797330.361019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240162d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788797330.361092:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797330.361099:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788797330.361104:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda99 00000020:00000080:3.0:1788797330.361109:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a240162e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.361126:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a240162f000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788797330.361131:0:36:0:(genops.c:885:class_export_put()) final put ffff9a240162b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.361133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240162b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788797330.361137:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788797330.361272:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788797330.361276:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797330.361280:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797330.361283:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9a23c41b3380) has no exports 00000020:00000080:3.0:1788797330.361297:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda8b 00000020:00000080:3.0:1788797330.361301:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c38e3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788797330.361317:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a240162e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1788797330.361664:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788797330.361668:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788797330.361670:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788797330.361675:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788797330.361676:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788797330.361698:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c38e3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788797330.361948:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797330.361954:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788797330.361963:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788797330.361967:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda7d 00000020:00000080:3.0:1788797330.361972:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c38e0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.361989:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c362d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788797330.361994:0:36:0:(genops.c:885:class_export_put()) final put ffff9a22c38e1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.361996:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c38e1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788797330.362000:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788797330.362094:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788797330.362098:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797330.362103:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788797330.362105:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9a23c41b19c0) has no exports 00000020:00000080:3.0:1788797330.362109:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda76 00000020:00000080:3.0:1788797330.362112:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c3628800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788797330.362128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c38e0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788797330.363083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c3628800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788797330.370917:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788797330.370940:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797330.370945:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797330.370953:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797330.371104:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797330.371118:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788797330.371142:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797330.371146:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788797330.371151:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c835d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788797330.371156:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c835d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788797330.371167:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788797330.371340:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda61 00000020:00000080:0.0:1788797330.371347:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c362f000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788797330.371450:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c362c800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788797330.371458:0:36:0:(genops.c:885:class_export_put()) final put ffff9a23c3629800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797330.371460:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c3629800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788797330.371465:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788797330.373144:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788797330.373387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c362f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788797330.373405:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797330.373415:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788797330.373420:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9a23c41b0000) has no exports 00000020:00000080:1.0:1788797330.373453:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797330.373458:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788797330.373463:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c3629000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788797330.373466:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c3629000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788797330.373470:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788797330.373677:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda68 00000020:00000080:1.0:1788797330.373684:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c362c000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788797330.373706:0:21012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a22c2ffa000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788797330.373710:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a22c2ffa000 2 00000020:01000004:1.0:1788797330.373713:0:21012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a22c2ffa000 from lustre-MDT0001 00000020:00000080:1.0:1788797330.373733:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797330.373737:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788797330.373739:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a23c362f800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788797330.373741:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c362f800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788797330.373747:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788797330.373771:0:21012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788797330.373774:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788797330.373776:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797330.373779:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788797330.373810:0:21012:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a22c3a72000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797330.373816:0:21012:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9a22c38119c0) has exports, disconnecting them 00000020:00080000:1.0:1788797330.373829:0:21012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a22c3a72000), last request at 1788797242 00000020:00000080:1.0:1788797330.373833:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdae6 00000020:00080000:1.0:1788797330.373844:0:21012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c3a72000): rc 0 00000020:00000080:1.0:1788797330.373848:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c3a72000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788797330.374332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c362c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788797330.374340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3a72000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788797330.375059:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788797330.375064:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797330.375069:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797330.375075:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797330.375097:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c3a75000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788797330.375365:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797330.375372:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788797330.375376:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c3a70800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788797330.375380:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3a70800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788797330.375394:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788797330.375456:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a22c2ffa000 1 00000020:00000080:0.0:1788797330.375461:0:21012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cda0d 00000020:00000080:0.0:1788797330.375466:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff9800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788797330.375708:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788797330.375717:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788797330.375727:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797330.375732:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788797330.375735:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9a22c3813380) has no exports 00000020:00000080:0.0:1788797330.457993:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797330.458008:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788797330.458014:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c2ff8800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788797330.458019:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ff8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788797330.458029:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788797330.458150:0:21012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a22c2ffe000 00000020:01000000:0.0:1788797330.458300:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788797330.458306:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797330.458311:0:21012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788797330.458315:0:21012:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9a2400980000) has no exports 00000100:00100000:3.0:1788797330.458488:0:17240:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9a22c1cb9400:17240] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.458629:0:20378:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9a23c4bfbe00:20378] 3 exiting: rc = 0 00000100:00100000:3.0:1788797330.458706:0:17241:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9a23c90f8000:17241] 1 exiting: rc = 0 00000100:00100000:2.0:1788797330.458979:0:17242:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9a23c90f9800:17242] 2 exiting: rc = 0 00000100:00100000:3.0:1788797330.459119:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459126:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459131:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459136:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459140:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459145:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459150:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459155:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459161:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459179:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459194:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459199:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459215:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459221:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459226:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459230:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459235:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459240:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459244:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459250:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459256:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459261:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459266:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459271:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459276:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459281:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459286:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459291:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459297:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459301:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459306:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459312:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459319:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459324:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459329:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459335:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459341:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459346:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459351:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459357:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459362:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459367:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459372:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459378:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459383:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459388:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459394:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459406:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459411:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459416:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459421:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459426:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459431:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459437:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459443:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459448:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459454:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459459:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459464:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459470:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.459475:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.460313:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.460318:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.460324:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797330.466621:0:17244:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a23c3e97000:17244] 1 exiting: rc = 0 00000100:00100000:2.0:1788797330.466821:0:17243:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a23c3e96800:17243] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.466940:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466950:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466957:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466962:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466967:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466972:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466977:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466982:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466987:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466992:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.466998:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467003:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467009:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467014:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467029:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467034:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467052:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467058:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467070:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467076:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467082:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467087:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467099:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467104:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467109:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467114:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467120:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467125:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467130:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467135:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467139:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467144:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467148:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467152:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467156:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467161:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467268:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467277:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467282:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467287:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467292:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467297:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467302:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467307:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467312:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467318:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467323:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467328:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467333:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467338:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467350:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467355:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467360:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467365:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467374:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467379:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467384:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467388:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467393:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.467398:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797330.468445:0:20432:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9a23d89f6000:20432] 2 exiting: rc = 0 00000100:00100000:0.0:1788797330.468645:0:17246:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9a240152ea00:17246] 1 exiting: rc = 0 00000100:00100000:1.0:1788797330.469127:0:17245:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9a22c32fc400:17245] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.469380:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469388:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469394:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469401:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469409:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469416:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469422:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469429:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469449:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469456:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469464:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469473:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469496:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469503:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469511:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469517:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469524:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469532:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469537:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469544:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469567:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469575:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469581:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469587:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469603:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469609:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469614:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469620:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469626:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469632:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469638:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469644:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469664:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469671:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469676:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469682:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469688:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469694:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469699:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469704:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469710:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469716:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469722:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469728:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469747:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469754:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469760:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469766:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469814:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469822:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469828:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469835:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469841:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469847:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469853:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469859:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469879:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469886:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469892:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469903:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469909:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469915:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469920:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.469925:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797330.482454:0:17248:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a22c32fc000:17248] 1 exiting: rc = 0 00000100:00100000:1.0:1788797330.482687:0:17247:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a23ec79c200:17247] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.482810:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482820:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482826:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482832:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482837:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482842:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482846:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482851:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482857:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482863:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482868:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482873:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482880:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482884:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482889:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482893:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482899:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482903:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482908:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482913:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482917:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482923:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482928:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482933:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482939:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482944:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482948:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482953:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482957:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482962:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482981:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482986:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482991:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.482995:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483001:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483006:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483011:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483017:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483021:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483026:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483031:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483036:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483041:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483045:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483051:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483056:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483061:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483065:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483071:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483076:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483082:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483086:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483091:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483096:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483100:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483104:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483109:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483113:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483118:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483123:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483128:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483133:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483138:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483143:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797330.483596:0:17250:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a23ec79d600:17250] 1 exiting: rc = 0 00000100:00100000:1.0:1788797330.483714:0:17249:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a22c32fc200:17249] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.483915:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483929:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483935:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483939:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483945:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483952:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483958:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483963:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483969:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483974:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483980:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483985:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483991:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.483996:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484001:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484007:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484012:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484024:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484029:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484034:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484039:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484045:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484050:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484056:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484061:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484066:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484071:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484077:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484081:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484086:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484091:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484095:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484100:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484105:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484110:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484123:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484127:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484132:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484137:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484141:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484145:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484150:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484154:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484158:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484162:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484178:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484184:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484202:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484207:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484211:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484216:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484221:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484226:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484231:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484235:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484240:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484245:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484249:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484255:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484260:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484266:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484271:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.484276:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797330.485779:0:17252:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a22c32fd200:17252] 1 exiting: rc = 0 00000100:00100000:1.0:1788797330.486248:0:17251:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a22c32fc800:17251] 0 exiting: rc = 1 00000100:00100000:3.0:1788797330.486752:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.486760:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.486777:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.486782:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487094:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487101:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487106:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487122:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487129:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487134:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487140:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487145:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487151:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487156:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487162:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487241:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487248:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487252:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487257:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487261:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487267:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487271:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487277:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487282:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487287:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487292:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487296:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487302:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487307:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487312:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487317:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487322:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487327:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487332:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487336:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487341:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487346:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487351:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487357:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487362:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487367:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487372:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487386:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487390:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487395:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487400:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487405:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487409:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487414:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487420:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487425:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487430:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487435:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487440:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487445:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487450:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487455:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487460:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487465:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487470:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487537:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487545:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487550:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.487555:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797330.488560:0:17253:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9a23c5165400:17253] 0 exiting: rc = 1 00000100:00100000:1.0:1788797330.488751:0:17254:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9a23c5165c00:17254] 1 exiting: rc = 0 00000100:00100000:1.0:1788797330.488945:0:17255:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9a23c5164c00:17255] 2 exiting: rc = 0 00000100:00100000:3.0:1788797330.489104:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489111:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489117:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489122:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489127:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489133:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489138:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489142:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489148:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489153:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489159:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489164:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489205:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489219:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489224:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489233:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489239:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489243:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489248:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489254:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489260:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489266:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489271:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489276:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489281:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489286:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489291:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489297:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489303:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489309:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489314:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489321:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489327:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489332:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489337:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489344:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489362:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489375:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489380:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489386:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489392:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489398:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489403:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489409:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489414:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489420:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489425:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489437:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489443:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489449:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489454:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489460:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489465:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489471:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489490:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489496:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489501:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489506:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489512:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489530:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489537:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489543:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797330.489548:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788797330.494338:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797330.494354:0:21012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788797330.494361:0:21012:0:(genops.c:885:class_export_put()) final put ffff9a22c40b4000/MDS_uuid 00000020:00000080:3.0:1788797330.494366:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c40b4000/MDS_uuid for MDS 00000020:01000000:3.0:1788797330.494378:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788797330.494662:0:21012:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788797330.614354:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797331.638325:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797332.660202:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797333.683011:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788797334.448832:0:21213:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788797334.468950:0:21213:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788797334.469004:0:21213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797334.469020:0:21213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797334.469027:0:21213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797334.469034:0:21213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797334.469055:0:21213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788797334.469074:0:21213:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788797334.469097:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797334.469103:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788797334.469109:0:21213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788797334.469115:0:21213:0:(import.c:65:import_set_state_nolock()) ffff9a23c4166000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788797334.469120:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797334.469122:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788797334.469124:0:21213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788797334.469948:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788797334.469952:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788797334.469956:0:21213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788797334.469978:0:21213:0:(import.c:65:import_set_state_nolock()) ffff9a22c33ff800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788797334.470204:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875689390451584:0@lo:39:umount.0 00000400:00000100:1.0:1788797334.470255:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390451584 offset 0 length 224: 4 00010000:00010000:3.0:1788797334.470646:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797334.470830:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797334.470851:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5c00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797334.470855:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797334.470882:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797334.470889:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797334.470896:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797334.470899:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788797334.470901:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788797334.470913:0:17230:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797334.470917:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797334.470923:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c12e5c00/0x6418c0ce308cdb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdb87 expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797334.470935:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797334.470937:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797334.470939:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797334.707053:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797335.091582:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788797335.091592:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797335.091595:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788797335.091599:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788797335.091603:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797335.091639:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 589 00000100:00080000:2.0:1788797335.091645:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788797335.091659:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a22c4390000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797335.091694:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d9a300 x1875689390451712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797335.092122:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875689390451840:0@lo:400:kworker.0 00000400:00000100:0.0:1788797335.092205:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390451840 offset 0 length 224: 4 00000100:00100000:1.0:1788797335.092434:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390451712:0@lo:38:kworker.0 00000400:00000100:1.0:1788797335.092455:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390451712 offset 0 length 520: 4 00010000:00010000:3.0:1788797335.731040:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788797336.118618:0:19560:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788797336.118626:0:19560:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce1800/lustre-MDT0001-mdtlov_UUID 00000100:00080000:3.0:1788797336.120010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797336.120020:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797336.120023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797336.120026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797336.120098:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390451968:0@lo:400:kworker.0 00000400:00000100:3.0:1788797336.121161:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390451968 offset 0 length 224: 4 00000020:00000080:2.0:1788797336.128762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788797336.128844:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ce4800 for lustre-OST0001 00000001:00100000:1.0:1788797336.134937:0:18743:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788797336.134956:0:18743:0:(genops.c:885:class_export_put()) final put ffff9a23c4163800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788797336.135043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c4163800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788797336.135166:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c4167800 for lustre-OST0000 00010000:00010000:3.0:1788797336.754963:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797337.779026:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797338.803150:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797339.827165:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797340.146834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797340.146846:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797340.146849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797340.146852:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797340.147036:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797340.147059:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390452096:0@lo:400:kworker.0 00000400:00000100:1.0:1788797340.147141:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390452096 offset 0 length 224: 4 00000100:00100000:1.0:1788797340.212544:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797330/real 1788797330] req@ffff9a22c41b4380 x1875689390451456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797340.212576:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c41b4380 x1875689390451456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788797340.212597:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788797340.212642:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788797340.212646:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390451456:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788797340.212817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797340.212822:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788797340.212825:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797340.212830:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1788797340.212835:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797340.212847:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.133@tcp: import ffff9a22c40b7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797340.212876:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e6300 x1875689390452224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797340.212899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797340.212903:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797340.213020:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390452352:0@lo:400:kworker.0 00000400:00000100:0.0:1788797340.213071:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390452352 offset 0 length 224: 4 00000100:00100000:1.0:1788797340.219725:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390452224:0@lo:250:kworker.0 00000400:00000100:1.0:1788797340.219850:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689390452224 offset 0 length 520: 4 00010000:00010000:3.0:1788797340.852708:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797341.875028:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797342.899247:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797343.923174:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797344.306929:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797334/real 1788797334] req@ffff9a22c41b4000 x1875689390451584/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797344 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797344.306962:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c41b4000 x1875689390451584/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797344 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788797344.306982:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c33ff800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788797344.307005:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875689390451584:0@lo:39:umount.0 00000100:00080000:0.0:1788797344.307110:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788797344.307114:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788797344.307119:0:21213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788797344.308492:0:21213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308513:0:21213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308523:0:21213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308551:0:21213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308707:0:21213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797344.308724:0:21213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308736:0:21213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308745:0:21213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797344.308755:0:21213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315180:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797344.315196:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315225:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901600 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797344.315229:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315238:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797344.315245:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797344.315250:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797344.315253:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788797344.315268:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797344.315271:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315278:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308cdb56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdb5d expref: -99 pid: 18742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315296:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797344.315300:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315305:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514400 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797344.315308:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315315:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797344.315326:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797344.315332:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788797344.315334:0:17229:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788797344.315340:0:17229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797344.315342:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797344.315348:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797344.315351:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797344.315353:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797344.321361:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797344.321656:0:21213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788797344.321668:0:21213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308cdeba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdec1 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797344.321688:0:21213:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788797344.321697:0:21213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788797344.321699:0:21213:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788797344.321734:0:21213:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788797344.321739:0:21213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788797344.321748:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797344.321754:0:21213:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788797344.321758:0:21213:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9a22c3ba8000) has no exports 00000020:00080000:0.0:1788797344.321780:0:21213:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9a22c3ba8000) has no exports 00000020:01000000:0.0:1788797344.332993:0:21213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c208bae0 - data ffff9a23eaf2b510/ffff9a23c4883400 00000020:01000000:0.0:1788797344.333142:0:21213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c2d761e0 - data ffff9a23eacb1798/ffff9a22c3917000 00100000:10000000:0.0:1788797344.342215:0:21213:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788797344.353949:0:21213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdb6b 00000020:00000080:1.0:1788797344.353962:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a22c38e3800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788797344.353978:0:21213:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23f246e000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788797344.353981:0:21213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23f246e000 2 00000020:01000004:1.0:1788797344.353984:0:21213:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a23f246e000 from lustre-OST0000 00000020:00000080:1.0:1788797344.354011:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797344.354021:0:21213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788797344.354024:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a22c3be2800/lustre-OST0000_UUID 00000020:00000080:1.0:1788797344.354027:0:21213:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3be2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788797344.354033:0:21213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788797344.354087:0:21213:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788797344.354091:0:21213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788797344.354095:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797344.354100:0:21213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788797344.354107:0:21213:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a23c4160800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797344.354112:0:21213:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9a22c3814d40) has exports, disconnecting them 00000020:00080000:1.0:1788797344.354124:0:21213:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a23c4160800), last request at 1788797257 00000020:00000080:1.0:1788797344.354128:0:21213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdb95 00000020:00080000:1.0:1788797344.354137:0:21213:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a23c4160800): rc 0 00000020:00000080:1.0:1788797344.354141:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a23c4160800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788797344.354743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c38e3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788797344.354759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c4160800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788797344.416041:0:21213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788797344.416053:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788797344.416094:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788797344.416104:0:21213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788797344.416419:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797344.416432:0:21213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788797344.416442:0:21213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788797344.416449:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797344.416456:0:21213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788797344.416465:0:21213:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a22c33ff000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788797344.416473:0:21213:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9a23f2418000) has exports, disconnecting them 00000020:00080000:2.0:1788797344.416480:0:21213:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a22c33ff000), last request at 1788797257 00000020:00000080:2.0:1788797344.416485:0:21213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdbaa 00000020:00080000:2.0:1788797344.416509:0:21213:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c33ff000): rc 0 00000020:00000080:2.0:1788797344.416516:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a22c33ff000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788797344.417210:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a23c4166000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788797344.417218:0:36:0:(genops.c:885:class_export_put()) final put ffff9a23c7c2b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788797344.417220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c7c2b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788797344.417231:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788797344.417290:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c33ff000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788797344.417313:0:21213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788797344.417317:0:21213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788797344.417320:0:21213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788797344.417323:0:21213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788797344.417346:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c33ff800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788797344.417481:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797344.417486:0:21213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788797344.417489:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a22c33fa000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788797344.417492:0:21213:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c33fa000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788797344.417495:0:21213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788797344.417528:0:21213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23f246e000 1 00000020:00000080:3.0:1788797344.417533:0:21213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdb48 00000020:00000080:3.0:1788797344.417538:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a23ff58d000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788797344.417544:0:21213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788797344.417550:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ff58d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788797344.417557:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797344.417561:0:21213:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788797344.417563:0:21213:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9a23f2afb380) has no exports 00000020:00000080:3.0:1788797344.722406:0:21213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797344.722426:0:21213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788797344.722432:0:21213:0:(genops.c:885:class_export_put()) final put ffff9a22c3a70000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788797344.722437:0:21213:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3a70000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788797344.722449:0:21213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788797344.722561:0:21213:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a22c1c26800 00000020:02000400:3.0:1788797344.722608:0:21213:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788797344.956689:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797345.331140:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797345.331151:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797345.331154:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797345.331157:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797345.331231:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797345.331252:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390452480:0@lo:400:kworker.0 00000400:00000100:3.0:1788797345.331308:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390452480 offset 0 length 224: 4 00010000:00010000:3.0:1788797345.971408:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797346.996916:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797348.025057:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797349.043816:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788797349.800849:0:21416:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788797349.843969:0:21416:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788797349.844080:0:21416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797349.844109:0:21416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797349.844117:0:21416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797349.844125:0:21416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797349.844155:0:21416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788797349.844161:0:21416:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788797349.844265:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797349.844272:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797349.844281:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514a00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797349.844291:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797349.844301:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797349.844309:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797349.844316:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797349.844318:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788797349.844321:0:17230:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788797349.844335:0:17230:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797349.844339:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797349.844346:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308cdcde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdce5 expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797349.844358:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797349.844360:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797349.844361:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797349.844482:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788797349.844495:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c2d9a300 x1875689390451712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797355 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.844517:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788797349.844523:0:21416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788797349.844530:0:21416:0:(import.c:65:import_set_state_nolock()) ffff9a22c4390000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788797349.844534:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788797349.844538:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c2d9a300 x1875689390451712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797355 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.844545:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788797349.844548:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1788797349.844620:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390451712:0@lo:38:kworker.0 00000100:00080000:2.0:1788797349.846031:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788797349.846043:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a22c2d98a80 x1875689390451840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797351 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.846063:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23d89e7100 x1875689390451968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.846453:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23d89e4e00 x1875689390452096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797356 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.846477:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23d89e4000 x1875689390452352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797356 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.846487:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23d89e4a80 x1875689390452480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797361 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797349.846494:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788797349.846500:0:21416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788797349.846525:0:21416:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788797349.846756:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875689390451840:0@lo:400:kworker.0 00000100:00100000:3.0:1788797349.846934:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390452352:0@lo:400:kworker.0 00000100:00100000:3.0:1788797349.846943:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390452096:0@lo:400:kworker.0 00000100:00100000:3.0:1788797349.846969:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875689390452608:0@lo:39:umount.0 00000400:00000100:3.0:1788797349.847033:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875689390452608 offset 0 length 224: 4 00000100:00100000:0.0:1788797349.857860:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390451968:0@lo:400:kworker.0 00000100:00100000:3.0:1788797349.858176:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390452480:0@lo:400:kworker.0 00010000:00010000:0.0:1788797350.067060:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797350.451486:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788797350.451496:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788797351.092515:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797352.115091:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797353.142705:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797354.163143:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797355.187535:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797355.571103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788797355.571113:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797356.021734:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797340/real 1788797340] req@ffff9a23d89e6300 x1875689390452224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797355 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797356.021768:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23d89e6300 x1875689390452224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788797355 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797356.021818:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797356.021830:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788797356.021834:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390452224:0@lo:250:kworker.0 00000100:00080000:1.0:1788797356.022257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788797356.022263:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788797356.022265:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797356.022271:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 600 00000100:00080000:1.0:1788797356.022286:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788797356.022298:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.133@tcp: import ffff9a22c40b7000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797356.022332:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c9880 x1875689390452736/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797356.023536:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390452736:0@lo:250:kworker.0 00000400:00000100:0.0:1788797356.023593:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875689390452736 offset 0 length 520: 4 00010000:00010000:0.0:1788797356.211094:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797357.236127:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797358.261876:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797359.091246:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797349/real 1788797349] req@ffff9a22c2d9a300 x1875689390452608/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797359.091291:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c2d9a300 x1875689390452608/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797359.091316:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c2ce0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788797359.091366:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875689390452608:0@lo:39:umount.0 00000100:00080000:2.0:1788797359.091416:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788797359.091422:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788797359.091427:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788797359.094413:0:21416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.094442:0:21416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.094450:0:21416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.094457:0:21416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.095334:0:21416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797359.095353:0:21416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.095389:0:21416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.095398:0:21416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797359.095405:0:21416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099296:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797359.099322:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099338:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515e00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797359.099343:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099356:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797359.099364:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797359.099370:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797359.099373:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788797359.099394:0:17230:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797359.099399:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099407:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401515e00/0x6418c0ce308cdcb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdcbb expref: -99 pid: 19559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099461:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797359.099467:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099488:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e9600 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797359.099492:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099505:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797359.099512:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797359.099517:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788797359.099520:0:17230:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788797359.099525:0:17230:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:3.0:1788797359.099528:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797359.099535:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797359.099537:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797359.099539:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797359.111066:0:21416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788797359.111086:0:21416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9600/0x6418c0ce308cdeac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cdeb3 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797359.111121:0:21416:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788797359.111134:0:21416:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788797359.111136:0:21416:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788797359.111189:0:21416:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788797359.111195:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788797359.111209:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797359.111216:0:21416:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797359.111222:0:21416:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9a23f2af99c0) has no exports 00000020:00080000:2.0:1788797359.111261:0:21416:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9a23f2af99c0) has no exports 00000020:01000000:2.0:1788797359.121407:0:21416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c208b960 - data ffff9a23eaf55ca8/ffff9a23fc6cfc00 00010000:00010000:0.0:1788797359.123046:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788797359.123279:0:21416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a22c30483c0 - data ffff9a22c185c438/ffff9a22c1e62c00 00100000:10000000:0.0:1788797359.147123:0:21416:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788797359.169148:0:21416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdcc9 00000020:00000080:0.0:1788797359.169168:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a22c4392800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788797359.169192:0:21416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a2400900800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788797359.169196:0:21416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a2400900800 2 00000020:01000004:0.0:1788797359.169200:0:21416:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a2400900800 from lustre-OST0001 00000020:00000080:0.0:1788797359.169244:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797359.169258:0:21416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788797359.169261:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a23c4153000/lustre-OST0001_UUID 00000020:00000080:0.0:1788797359.169264:0:21416:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23c4153000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788797359.169272:0:21416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788797359.169424:0:21416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3d5a02fe-c590-4f5d-9073-3000c2955450->MGS 00010000:00010000:0.0:1788797359.169449:0:21416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021df400/0x6418c0ce308cda14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cda1b expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797359.169463:0:21416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021df400/0x6418c0ce308cda14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cda1b expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797359.169481:0:21416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788797359.169484:0:21416:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788797359.169489:0:21416:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788797359.169514:0:21416:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:0.0:1788797359.169518:0:21416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021df400/0x6418c0ce308cda14 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cda1b expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797359.169535:0:21416:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a24021dea00/0x6418c0ce308cd903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6418c0ce308cd90a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797359.169559:0:21416:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a24021dea00/0x6418c0ce308cd903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6418c0ce308cd90a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797359.169564:0:21416:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797359.169567:0:21416:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788797359.169569:0:21416:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788797359.169579:0:21416:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a22c40b7000 00010000:00010000:0.0:1788797359.169581:0:21416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a24021dea00/0x6418c0ce308cd903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6418c0ce308cd90a expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788797359.169602:0:21416:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b7000 MGS: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788797359.170157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4392800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1788797359.170466:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788797359.170680:0:21416:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788797359.170683:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788797359.170871:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788797359.170886:0:21416:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a23f90c9880 x1875689390452736/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788797376 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788797359.170922:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788797359.170925:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1788797359.171002:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d5a02fe-c590-4f5d-9073-3000c2955450:3615:1875689390452736:0@lo:250:kworker.0 10000000:01000000:1.0:1788797359.171111:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788797359.171123:0:21416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cd8ee 00000020:00000080:1.0:1788797359.171134:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a22c40b2800/3d5a02fe-c590-4f5d-9073-3000c2955450 00000020:01000000:1.0:1788797359.171156:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.133@tcp (flags='') 00000020:00000080:1.0:1788797359.171169:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797359.171194:0:21416:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.133@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788797359.171199:0:21416:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9a24009819c0) has no exports 00000020:00000080:2.0:1788797359.171265:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c40b2800/3d5a02fe-c590-4f5d-9073-3000c2955450 for MGC192.168.202.133@tcp 10000000:01000000:2.0:1788797359.171308:0:17238:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788797359.171424:0:21416:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.133@tcp: client import never connected 00000100:00080000:1.0:1788797359.171427:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788797359.171429:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788797359.171431:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788797359.171433:0:21416:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788797359.171488:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797359.171503:0:21416:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.133@tcp (uuid 3d5a02fe-c590-4f5d-9073-3000c2955450) 00000020:01000000:1.0:1788797359.171512:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788797359.171516:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797359.171520:0:21416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788797359.171526:0:21416:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a22c4397800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788797359.171532:0:21416:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9a22c435b380) has exports, disconnecting them 00000020:00080000:1.0:1788797359.171537:0:21416:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a22c4397800), last request at 1788797275 00000020:00000080:1.0:1788797359.171541:0:21416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdcf3 00000020:00080000:1.0:1788797359.171553:0:21416:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c4397800): rc 0 00000020:00000080:1.0:1788797359.171557:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a22c4397800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788797359.171840:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c40b7000 for MGC192.168.202.133@tcp 00000020:00000080:2.0:1788797359.171851:0:36:0:(genops.c:885:class_export_put()) final put ffff9a22c40b2000/3d5a02fe-c590-4f5d-9073-3000c2955450 00000020:00000080:2.0:1788797359.171854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c40b2000/3d5a02fe-c590-4f5d-9073-3000c2955450 for MGC192.168.202.133@tcp 00000020:01000000:2.0:1788797359.171859:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.133@tcp (3d5a02fe-c590-4f5d-9073-3000c2955450) 00000020:00000080:2.0:1788797359.173740:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4397800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788797359.174891:0:21416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788797359.174899:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788797359.174905:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788797359.174913:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788797359.175163:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797359.175177:0:21416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788797359.175186:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788797359.175193:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797359.175199:0:21416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788797359.175208:0:21416:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a22c3be7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788797359.175216:0:21416:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9a22c43599c0) has exports, disconnecting them 00000020:00080000:0.0:1788797359.175223:0:21416:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a22c3be7000), last request at 1788797275 00000020:00000080:0.0:1788797359.175227:0:21416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdd08 00000020:00080000:0.0:1788797359.175264:0:21416:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a22c3be7000): rc 0 00000020:00000080:0.0:1788797359.175272:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a22c3be7000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788797359.176807:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c4390000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788797359.176829:0:36:0:(genops.c:885:class_export_put()) final put ffff9a22c4390800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788797359.176834:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c4390800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788797359.176843:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788797359.176957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c3be7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788797359.196929:0:21416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788797359.196946:0:21416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788797359.196953:0:21416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788797359.196964:0:21416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788797359.197009:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a22c2ce0800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788797359.197099:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788797359.202489:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788797359.203775:0:17224:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a23d08dd400:17224] 0 exiting: rc = 1 00000100:00100000:1.0:1788797359.204340:0:17225:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a23de5f5e00:17225] 1 exiting: rc = 0 00000100:00100000:0.0:1788797359.206016:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.207152:0:17226:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a22c1cbaa00:17226] 0 exiting: rc = 1 00000100:00100000:1.0:1788797359.207298:0:18394:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a23fa7fbe00:18394] 3 exiting: rc = 0 00000100:00100000:2.0:1788797359.209343:0:17227:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a23de5f4a00:17227] 1 exiting: rc = 0 00000100:00100000:3.0:1788797359.210329:0:17228:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a23de5f4c00:17228] 2 exiting: rc = 0 00000100:00100000:0.0:1788797359.210954:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.210974:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.210981:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.210988:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211000:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211009:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211018:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211023:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211251:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211260:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211267:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211273:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211280:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211285:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211292:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211297:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211304:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211309:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211315:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211321:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211327:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211333:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211339:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211344:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211349:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211354:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211360:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211365:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211370:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211375:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211397:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211402:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211408:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211415:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211423:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211429:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211435:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211441:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211446:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211453:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211459:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211466:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211730:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211739:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211745:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211751:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211758:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211765:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211770:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211775:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211781:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211960:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211970:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211976:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211981:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211986:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211992:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.211998:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212003:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212008:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212014:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212020:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212026:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.212116:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788797359.217183:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797359.217200:0:21416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788797359.217211:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a22c2ce1000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788797359.217217:0:21416:0:(genops.c:844:class_export_destroy()) destroying export ffff9a22c2ce1000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788797359.217227:0:21416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788797359.217324:0:21416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a2400900800 1 00000020:00000080:2.0:1788797359.217333:0:21416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6418c0ce308cdcad 00000020:00000080:2.0:1788797359.217341:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a23d0100000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788797359.217406:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788797359.217412:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797359.217419:0:21416:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788797359.217423:0:21416:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9a23f2afcd40) has no exports 00000020:00000080:0.0:1788797359.220657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23d0100000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788797359.261303:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797359.261326:0:21416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788797359.261335:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a2400903800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788797359.261341:0:21416:0:(genops.c:844:class_export_destroy()) destroying export ffff9a2400903800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788797359.261359:0:21416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788797359.261728:0:21416:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a2400904000 00000020:01000000:1.0:1788797359.261766:0:21416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788797359.261772:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788797359.261777:0:21416:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788797359.261782:0:21416:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9a22c3810000) has no exports 00000020:00000080:1.0:1788797359.261858:0:21416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788797359.261863:0:21416:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788797359.261866:0:21416:0:(genops.c:885:class_export_put()) final put ffff9a23ff58c800/OSS_uuid 00000020:00000080:1.0:1788797359.261869:0:21416:0:(genops.c:844:class_export_destroy()) destroying export ffff9a23ff58c800/OSS_uuid for OSS 00000020:01000000:1.0:1788797359.261873:0:21416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788797359.261986:0:19150:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9a22c39c1400:19150] 3 exiting: rc = 0 00000100:00080000:2.0:1788797359.262676:0:17237:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788797359.263112:0:18749:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9a23fa634e00:18749] 2 exiting: rc = 0 00000100:00100000:3.0:1788797359.263198:0:18748:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9a22c23f8400:18748] 1 exiting: rc = 0 00000100:00100000:3.0:1788797359.263254:0:18746:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9a23c8302c00:18746] 0 exiting: rc = 1 00000100:00100000:1.0:1788797359.263383:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263393:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263399:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263405:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263411:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263416:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263423:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263429:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263435:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263441:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263447:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263453:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263481:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263489:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263561:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263571:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263578:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263583:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263590:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263596:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263602:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263609:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263615:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263622:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263628:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263634:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263640:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263647:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263654:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263682:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263690:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263696:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263702:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263708:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263714:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263720:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263727:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263733:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263741:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263748:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263754:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263760:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263765:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263771:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263777:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263782:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263824:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263831:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263836:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263842:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263850:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263857:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263863:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263869:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263875:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.263886:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264101:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264108:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264113:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264120:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264125:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264130:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264136:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.264142:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.268194:0:18751:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a22c227b000:18751] 1 exiting: rc = 0 00000100:00100000:0.0:1788797359.268494:0:18750:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a23f9268800:18750] 0 exiting: rc = 1 00000100:00100000:3.0:1788797359.269180:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269210:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269216:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269223:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269229:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269234:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269239:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269244:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269251:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269257:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269264:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269271:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269277:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269283:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269289:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269295:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269324:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269331:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269337:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269343:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269349:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269356:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269362:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269368:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269374:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269380:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269386:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269392:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269399:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269405:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269410:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269416:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269423:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269428:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269435:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269440:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269453:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269459:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269465:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.269996:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270009:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270015:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270020:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270027:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270033:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270038:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270044:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270050:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270057:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270061:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270066:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270071:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270076:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270082:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270087:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270091:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270097:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270102:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270107:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270112:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270118:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270124:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270129:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797359.270135:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.272279:0:18753:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a23f2b54600:18753] 1 exiting: rc = 0 00000100:00100000:0.0:1788797359.272527:0:18754:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a23f2b54e00:18754] 2 exiting: rc = 0 00000100:00100000:3.0:1788797359.273089:0:18752:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a23c7d1c400:18752] 0 exiting: rc = 1 00000100:00100000:0.0:1788797359.273227:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273239:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273246:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273253:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273277:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273298:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273305:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273313:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273320:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273326:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273333:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273339:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273346:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273353:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273360:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273368:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273376:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273384:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273391:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273398:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273405:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273413:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273422:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273430:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273438:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273445:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273452:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273461:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273598:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273627:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273637:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273665:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273672:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273680:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273689:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273696:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273704:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273710:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273717:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273724:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273732:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273740:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273748:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273756:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273764:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273772:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273779:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273858:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273867:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273874:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.273881:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274259:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274269:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274276:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274282:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274299:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274314:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274321:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274329:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274337:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274344:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274350:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274356:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797359.274363:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.300089:0:18755:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a23fa7fbc00:18755] 0 exiting: rc = 1 00000100:00100000:3.0:1788797359.302755:0:18756:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a23fa7fa600:18756] 1 exiting: rc = 0 00000100:00100000:1.0:1788797359.303110:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303119:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303126:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303131:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303137:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303143:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303149:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303154:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303160:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303165:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303171:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303178:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303184:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303191:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303197:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303204:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303209:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303214:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303220:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303226:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303231:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303237:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303242:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303248:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303253:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303259:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303264:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303270:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303275:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303281:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303286:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303292:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303298:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303303:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303326:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303333:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303338:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303343:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303348:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303354:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303359:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303381:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303389:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303395:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303400:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303406:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303411:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303417:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303424:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303429:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303435:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303441:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303446:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303452:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303458:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303463:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303468:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303474:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303480:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303486:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.303491:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.306042:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.306056:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.306062:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797359.307447:0:18757:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a23fa650800:18757] 0 exiting: rc = 1 00000100:00100000:2.0:1788797359.307588:0:18758:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a23fa651600:18758] 1 exiting: rc = 0 00000100:00100000:1.0:1788797359.307873:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308019:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308028:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308034:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308041:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308066:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308073:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308079:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308085:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308091:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308097:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308104:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308110:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308131:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308140:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308146:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308152:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308158:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308164:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308170:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308176:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308182:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308188:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308195:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308202:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308223:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308231:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308237:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308243:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308249:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308256:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308263:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308269:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308275:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308282:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308288:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308294:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308313:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308320:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308326:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308338:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308344:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308351:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308357:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.308364:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311646:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311663:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311669:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311677:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311721:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311729:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311735:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311742:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311749:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311757:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311763:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311770:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311776:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.311783:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.312674:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.312682:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.312689:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.312697:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797359.312719:0:21416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788797359.346336:0:21416:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788797382.998537:0:22186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788797394.479696:0:22789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788797394.479703:0:22789:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788797394.479704:0:22789:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788797394.479843:0:22789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a23fc5fe800 00000020:01000004:1.0:1788797394.479859:0:22789:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788797394.479866:0:22789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788797394.479879:0:22789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a22c3810000) 00000020:00000080:1.0:1788797394.479891:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788797394.574941:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788797394.582052:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.584607:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.584924:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.585142:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.585514:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.588911:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.589459:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.589713:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.590088:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.590413:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.590656:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.590971:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.591213:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.591490:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.591686:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.595006:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.596470:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.596837:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.598632:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.599121:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.599394:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.599648:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.599958:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.600208:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.600592:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.600844:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.601366:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.601662:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.601961:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.602460:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.602763:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.603176:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788797394.603515:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788797394.604966:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.609154:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797394.612321:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.614875:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.615327:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797394.615572:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.615847:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788797394.616096:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788797394.616359:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.616620:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.616872:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797394.617125:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788797394.617393:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788797394.620820:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788797394.624442:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788797394.626933:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788797394.628348:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788797394.628599:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788797394.630023:0:22789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1788797394.633455:0:22789:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788797394.633721:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788797394.633731:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788797394.633743:0:22789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce161 00000020:01000004:1.0:1788797394.633750:0:22789:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788797394.633755:0:22789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788797394.633761:0:22789:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a23fc5fe800 from MGS 00000020:01000004:1.0:1788797394.633765:0:22789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788797394.633776:0:22789:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a22c3814d40) 00000020:00000080:1.0:1788797394.633807:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788797394.633870:0:22789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23fc5fe800 from MGS, refs=2 00080000:01000000:1.0:1788797394.633875:0:22789:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788797394.633880:0:22789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce16f 00000100:00100000:1.0:1788797394.633974:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788797394.634103:0:22789:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788797394.634109:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788797394.644290:0:22789:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788797394.644320:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788797394.645238:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797394.645567:0:22789:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788797394.645573:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788797394.646411:0:22789:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788797394.646419:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788797394.646707:0:22789:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788797394.646713:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788797394.651684:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797394.651691:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797394.651694:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797394.661027:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797394.661033:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797394.661036:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797394.661782:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788797394.663354:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788797394.674997:0:22789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788797394.687956:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788797394.688030:0:22789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788797394.688088:0:22789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788797394.692693:0:22789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788797394.693142:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797394.693767:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788797394.693774:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788797394.694497:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788797394.694510:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788797394.695509:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788797394.695517:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788797394.698760:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788797394.698784:0:22789:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.133@tcp' 00000020:01000004:0.0:1788797394.698819:0:22789:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788797394.698850:0:22789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.133@tcp (typ=mgc) 00000020:00000080:0.0:1788797394.698864:0:22789:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.133@tcp (ffff9a23f241b380) 00000020:00000080:0.0:1788797394.698880:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788797394.698963:0:22789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a22c4a9b800@MGC192.168.202.133@tcp: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1788797394.699123:0:22789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.133@tcp-0 is initialized 00000040:01000000:0.0:1788797394.699129:0:22789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788797394.699681:0:22806:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788797394.710439:0:22807:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788797394.710637:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.133@tcp (uuid 42e4a701-62a9-467c-87db-46cabbbe5ca1) 00000020:00000080:1.0:1788797394.710661:0:22789:0:(genops.c:1384:class_connect()) connect: client 42e4a701-62a9-467c-87db-46cabbbe5ca1, cookie 0x6418c0ce308ce17d 00000100:00080000:1.0:1788797394.710672:0:22789:0:(import.c:545:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797394.710684:0:22789:0:(import.c:666:import_select_connection()) MGC192.168.202.133@tcp: import ffff9a22c4a9b800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797394.710717:0:22789:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90cb800 x1875689390452864/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797394.710759:0:22789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 42e4a701-62a9-467c-87db-46cabbbe5ca1->MGS 00000020:01000004:1.0:1788797394.710777:0:22789:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788797394.710782:0:22789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788797394.710859:0:22789:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a22c3813380) 00000020:00000080:1.0:1788797394.710873:0:22789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788797394.711697:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42e4a701-62a9-467c-87db-46cabbbe5ca1:3615:1875689390452864:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788797394.711758:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797394.711836:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390452864 00000100:00100000:3.0:1788797394.711844:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390452864 00000100:00100000:3.0:1788797394.711872:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797394.711878:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3615:x1875689390452864:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788797394.711900:0:22803:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 42e4a701-62a9-467c-87db-46cabbbe5ca1@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:3.0:1788797394.711922:0:22803:0:(genops.c:1384:class_connect()) connect: client 42e4a701-62a9-467c-87db-46cabbbe5ca1, cookie 0x6418c0ce308ce18b 00000100:00080000:3.0:1788797394.712086:0:22803:0:(import.c:65:import_set_state_nolock()) ffff9a23f66f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797394.712132:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:3615:x1875689390452864:12345-0@lo:250:mount.lustre.0 Request processed in 254us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797394.712139:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797394.712172:0:3615:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.133@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788797394.712180:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.133@tcp: connect to target with instance 0 00000100:00080000:3.0:1788797394.712187:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.133@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788797394.712190:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788797394.712193:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4a9b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788797394.712196:0:3615:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788797394.712203:0:3615:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788797394.712208:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42e4a701-62a9-467c-87db-46cabbbe5ca1:3615:1875689390452864:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788797394.736106:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797394.736448:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788797394.736455:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788797394.738820:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788797394.738830:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788797394.739203:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788797394.739209:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788797394.740081:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797394.740452:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788797394.740458:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788797394.752818:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788797394.752841:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788797394.824658:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797394.825904:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788797394.825911:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788797394.827181:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788797394.827192:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788797394.830218:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797394.830970:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797394.830978:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788797394.843392:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788797394.843412:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788797394.844394:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797394.844591:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797394.844597:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788797394.845820:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788797394.845830:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788797394.847007:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797394.847179:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788797394.847184:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788797394.856249:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788797394.856269:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788797394.895037:0:22789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797394.895330:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797394.895336:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788797394.924855:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788797394.924877:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788797394.928269:0:22789:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788797394.928287:0:22789:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788797394.930011:0:22789:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788797394.930041:0:22789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788797394.930055:0:22789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788797394.930181:0:22789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797394.930215:0:22789:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788797394.930219:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797394.930221:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797394.930222:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797394.930223:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797394.930224:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797394.930226:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797394.930227:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797394.930228:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797394.930230:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797394.930231:0:22789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797394.930234:0:22789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788797394.930235:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797394.930237:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797394.930238:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797394.930239:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797394.930240:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797394.930241:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797394.930242:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797394.930243:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797394.930244:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797394.930244:0:22789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797394.930271:0:22789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788797394.930290:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390452992:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797394.930371:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797394.930923:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c4f68e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797394.931318:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390452992 00000100:00100000:1.0:1788797394.931326:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390452992 00000100:00100000:1.0:1788797394.932013:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797394.932025:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:22789:x1875689390452992:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797394.932079:0:22805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788797394.932083:0:22805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788797394.932090:0:22805:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788797394.937595:0:22826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788797394.940644:0:22805:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788797394.943201:0:22827:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788797394.943209:0:22827:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788797394.943212:0:22827:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788797394.943215:0:22827:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788797394.943566:0:22827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788797394.953819:0:22805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788797394.953833:0:22805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788797394.955697:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:22789:x1875689390452992:12345-0@lo:253:mount.lustre.0 Request processed in 23662us (25313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797394.955714:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797394.956004:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390452992:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788797394.956020:0:22789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788797394.956023:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788797394.956025:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797394.956026:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797394.956028:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797394.956029:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797394.956030:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797394.956031:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797394.956033:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797394.956035:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797394.956036:0:22789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788797394.956056:0:22789:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a23fc5fe800 from lustre-MDT0000 10000000:01000000:1.0:1788797394.956087:0:22789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788797394.956090:0:22789:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788797394.956094:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a23f241b380 10000000:01000000:1.0:1788797394.956097:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797394.956105:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a23f241b380 from 1 10000000:01000000:1.0:1788797394.956108:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788797394.956147:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797394.956171:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797394.956182:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797394.956219:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797394.956258:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797394.956293:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f92cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797394.956476:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453120 00000100:00100000:3.0:1788797394.956490:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453120 00000100:00100000:3.0:1788797394.956593:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797394.956603:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:22789:x1875689390453120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797394.956618:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797394.956634:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401515400/0x6418c0ce308ce199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce192 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797394.956660:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515400/0x6418c0ce308ce199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce192 expref: 6 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797394.956672:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401515400/0x6418c0ce308ce199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce192 expref: 6 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797394.956682:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401515400, rc 0) 00000100:00100000:3.0:1788797394.956727:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:22789:x1875689390453120:12345-0@lo:101:mount.lustre.0 Request processed in 127us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797394.956734:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797394.956836:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797394.956851:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797394.956861:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797394.956913:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797394.956940:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797394.960400:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f92cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797394.976401:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453248 00000100:00100000:0.0:1788797394.976417:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453248 00000100:00100000:0.0:1788797394.976490:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797394.976500:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:22789:x1875689390453248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797394.976654:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:22789:x1875689390453248:12345-0@lo:501:mount.lustre.0 Request processed in 155us (19713us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788797394.976661:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797394.976726:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453248:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788797394.976801:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788797394.976828:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.976839:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797394.976848:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a23fc5fe800 10000000:01000000:0.0:1788797394.976853:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788797394.976858:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a23fc5fe800 10000000:01000000:0.0:1788797394.976860:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788797394.976863:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a23fc5fe800 from 1 10000000:01000000:0.0:1788797394.976866:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788797394.976897:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.976905:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.976915:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797394.976936:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797394.976969:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797394.976997:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a240147b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788797394.977016:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453376 00000100:00100000:0.0:1788797394.977020:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453376 00000100:00100000:0.0:1788797394.977038:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797394.977044:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:22789:x1875689390453376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797394.977061:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797394.977074:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9c00/0x6418c0ce308ce1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce1a0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977098:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9c00/0x6418c0ce308ce1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce1a0 expref: 7 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977107:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9c00/0x6418c0ce308ce1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce1a0 expref: 7 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977114:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9c00, rc 0) 00000100:00100000:0.0:1788797394.977143:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+7:22789:x1875689390453376:12345-0@lo:101:mount.lustre.0 Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797394.977149:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797394.977197:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797394.977210:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1a7 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977218:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce1a7 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797394.977230:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788797394.977236:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1a7 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977244:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8800/0x6418c0ce308ce1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1a7 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797394.977249:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788797394.977258:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788797394.977262:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a23fc5fe800 10000000:01000000:0.0:1788797394.977264:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788797394.977266:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788797394.977268:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788797394.977282:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977288:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977295:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797394.977306:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797394.977329:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797394.977341:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a240147b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788797394.977356:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453504 00000100:00100000:0.0:1788797394.977359:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453504 00000100:00100000:0.0:1788797394.977374:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797394.977379:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+7:22789:x1875689390453504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797394.977386:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797394.977393:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9400/0x6418c0ce308ce1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce1ae expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977406:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9400/0x6418c0ce308ce1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce1ae expref: 8 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977412:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9400/0x6418c0ce308ce1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce1ae expref: 8 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977428:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9400, rc 0) 00000100:00100000:0.0:1788797394.977456:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+8:22789:x1875689390453504:12345-0@lo:101:mount.lustre.0 Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797394.977462:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797394.977494:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797394.977505:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1b5 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797394.977512:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce1b5 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797394.977556:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797394.977589:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797394.977602:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c51519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797394.977616:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453632 00000100:00100000:0.0:1788797394.977619:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453632 00000100:00100000:0.0:1788797394.977637:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797394.977643:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+8:22789:x1875689390453632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797394.977750:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22789:x1875689390453632:12345-0@lo:501:mount.lustre.0 Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797394.977756:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797394.977785:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797394.977843:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797394.977877:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797394.977897:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c51519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797394.977908:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453760 00000100:00100000:0.0:1788797394.977912:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453760 00000100:00100000:0.0:1788797394.977937:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797394.977943:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22789:x1875689390453760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797394.981549:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22789:x1875689390453760:12345-0@lo:503:mount.lustre.0 Request processed in 3594us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797394.981566:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797394.981662:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390453760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797394.987189:0:22828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22828:1875689390453888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797394.987301:0:22828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797394.987344:0:22828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c5151000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797394.987773:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390453888 00000100:00100000:1.0:1788797394.987782:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390453888 00000100:00100000:1.0:1788797394.987868:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797394.987877:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22828:x1875689390453888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797394.988734:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22828:x1875689390453888:12345-0@lo:502:llog_process_th.0 Request processed in 855us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797394.988743:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797394.989460:0:22828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22828:1875689390453888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797394.989631:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797394.989645:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797394.989648:0:22828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788797394.989654:0:22828:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788797394.989657:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797394.989674:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a23f241cd40) 00000020:00000080:0.0:1788797394.989691:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788797394.989696:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788797394.989904:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788797394.989914:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce1c3 00000020:00000080:0.0:1788797394.990122:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788797394.990127:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797394.990131:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797394.990132:0:22828:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788797394.990136:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797394.990146:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797394.990147:0:22828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788797394.990151:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797394.991127:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a23f24199c0) 00000020:00000080:0.0:1788797394.991149:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788797394.991169:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788797394.991171:0:22828:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788797394.991174:0:22828:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788797394.991181:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788797394.991254:0:22828:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23fc5fe800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788797394.991269:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a23f2418000) 00000020:00000080:0.0:1788797394.991277:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788797394.991329:0:22828:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788797394.991336:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce1d8 00000020:00000080:0.0:1788797394.991445:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788797394.991452:0:22828:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788797394.991457:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6418c0ce308ce1df 00080000:01000000:0.0:1788797394.991462:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788797394.991465:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce1e6 00010000:00010000:1.0:1788797395.104532:0:22828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788797395.105940:0:22828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:1.0:1788797395.106830:0:22828:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788797395.107514:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a22c38119c0) 00000020:00000080:1.0:1788797395.107533:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788797395.107629:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788797395.107637:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce1f4 00000020:00000080:0.0:1788797395.108715:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788797395.120060:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6418c0ce308ce1fb 00000020:00000080:0.0:1788797395.121453:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788797395.121469:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.121477:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.121479:0:22828:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788797395.121484:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788797395.121486:0:22828:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788797395.121488:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797395.121490:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797395.121491:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788797395.121494:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.121495:0:22828:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788797395.121498:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797395.121503:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.123033:0:22828:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788797395.123061:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788797395.123117:0:22828:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788797395.123140:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.123144:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.123145:0:22828:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788797395.123148:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797395.123153:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.123154:0:22828:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788797395.123157:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788797395.123162:0:22828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:0.0:1788797395.123190:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797395.123206:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a22c20bb380) 00000020:00000080:0.0:1788797395.123222:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788797395.123227:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788797395.123297:0:22828:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788797395.123303:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788797395.123311:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce209 00010000:00080000:2.0:1788797395.134269:0:22828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23ff58f000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797395.137508:0:22828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788797395.140078:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797395.140094:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788797395.140136:0:22828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788797395.140155:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce210 00000100:00080000:3.0:1788797395.140166:0:22828:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797395.140180:0:22828:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797395.140218:0:22828:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e4a80 x1875689390454016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797395.140245:0:22828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788797395.140469:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797395.140474:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797395.140476:0:22828:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788797395.140491:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788797395.140494:0:22828:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788797395.140495:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797395.140497:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797395.140499:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788797395.140501:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797395.140503:0:22828:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788797395.140505:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788797395.140509:0:22828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788797395.140512:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797395.140514:0:22828:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788797395.140517:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788797395.140521:0:22828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:3.0:1788797395.140543:0:22828:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788797395.140546:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797395.140558:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a22c3bacd40) 00000020:00000080:3.0:1788797395.140570:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788797395.140586:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788797395.140646:0:22828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788797395.140652:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788797395.140658:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce21e 00010000:00080000:3.0:1788797395.140685:0:22828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23efaab000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:3.0:1788797395.141061:0:22828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788797395.141353:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797395.141421:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.141864:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454016 00000100:00100000:2.0:1788797395.141874:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454016 00000100:00100000:2.0:1788797395.141905:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797395.141912:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390454016:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788797395.141927:0:22815:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788797395.144214:0:22828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788797395.147420:0:22828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788797395.154054:0:22828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797395.154287:0:22828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788797395.158980:0:22828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788797395.159572:0:22834:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788797395.159588:0:22834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788797395.160075:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390454016:12345-0@lo:38:llog_process_th.0 Request processed in 18157us (18648us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797395.160090:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788797395.160093:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797395.160100:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788797395.160105:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454016:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788797395.160517:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788797395.160529:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797395.160564:0:22828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788797395.160594:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce225 00000100:00080000:1.0:1788797395.160601:0:22828:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797395.160610:0:22828:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a23efaab000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797395.160640:0:22828:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c9180 x1875689390454144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797395.160690:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454144:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788797395.160752:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390454144 offset 0 length 520: 4 00000100:00080000:0.0:1788797395.161038:0:22828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788797395.161095:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.161099:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.161101:0:22828:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788797395.161105:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788797395.161107:0:22828:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788797395.161114:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797395.161115:0:22828:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797395.161117:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788797395.161119:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.161121:0:22828:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788797395.161123:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788797395.161127:0:22828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788797395.161130:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.161131:0:22828:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788797395.161134:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788797395.161138:0:22828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:0.0:1788797395.161166:0:22828:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788797395.161169:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797395.161180:0:22828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a22c20bcd40) 00000020:00000080:0.0:1788797395.161193:0:22828:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788797395.161197:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788797395.161256:0:22828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788797395.161262:0:22828:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788797395.161268:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6418c0ce308ce233 00010000:00080000:0.0:1788797395.161304:0:22828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a22c4397000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:0.0:1788797395.161639:0:22828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788797395.161704:0:22828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788797395.161782:0:22828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788797395.163533:0:22828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797395.163771:0:22828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788797395.164014:0:22828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788797395.165184:0:22836:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788797395.165198:0:22836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788797395.166112:0:22828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788797395.166121:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788797395.166149:0:22828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788797395.166218:0:22828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce23a 00000100:00080000:0.0:1788797395.166230:0:22828:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788797395.166242:0:22828:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797395.166290:0:22828:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c41b4700 x1875689390454272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797395.166385:0:22828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788797395.166446:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454272:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788797395.166488:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390454272 offset 0 length 520: 4 00000020:01000000:0.0:1788797395.166571:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.166585:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.166587:0:22828:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788797395.166590:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797395.166595:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.166597:0:22828:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788797395.166600:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788797395.166602:0:22828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788797395.166608:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.166610:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.166611:0:22828:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788797395.166613:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797395.166616:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.166617:0:22828:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788797395.166620:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788797395.166648:0:22828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22828:1875689390454400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797395.166697:0:22828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797395.166956:0:22828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c38b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797395.166985:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454400 00000100:00100000:1.0:1788797395.166991:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454400 00000100:00100000:1.0:1788797395.167048:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788797395.167055:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22828:x1875689390454400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797395.167161:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22828:x1875689390454400:12345-0@lo:502:llog_process_th.0 Request processed in 100us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797395.167166:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797395.167233:0:22828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22828:1875689390454400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797395.167261:0:22828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797395.167265:0:22828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797395.167267:0:22828:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788797395.167270:0:22828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788797395.167612:0:22789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788797395.167631:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788797395.167649:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1b5 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797395.167661:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8000/0x6418c0ce308ce1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce1b5 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797395.167670:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a23fc5fe800 from 1 10000000:01000000:2.0:1788797395.167680:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797395.167720:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797395.167729:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797395.167738:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797395.167752:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797395.167824:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.168524:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797395.168559:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454528 00000100:00100000:3.0:1788797395.168564:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454528 00000100:00100000:3.0:1788797395.168600:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797395.168613:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+9:22789:x1875689390454528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797395.168624:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797395.168638:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce241 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.168658:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 10 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.168669:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 10 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.168677:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401515e00, rc 0) 00000100:00100000:3.0:1788797395.168724:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+10:22789:x1875689390454528:12345-0@lo:101:mount.lustre.0 Request processed in 117us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797395.168730:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797395.168942:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797395.168955:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.168965:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797395.169474:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454656:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788797395.169513:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.169547:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6f2e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788797395.169676:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454656 00000100:00100000:0.0:1788797395.169681:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454656 00000100:00100000:0.0:1788797395.169705:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797395.169725:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+10:22789:x1875689390454656:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788797395.169748:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788797395.169754:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788797395.169846:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+10:22789:x1875689390454656:12345-0@lo:256:mount.lustre.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797395.169853:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797395.170035:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454656:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788797395.170665:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797395.170692:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.170705:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797395.171087:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a23fc5fe800 from 1 10000000:01000000:3.0:1788797395.171089:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797395.171115:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.171120:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.171126:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797395.171137:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797395.171242:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.171304:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6f2e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788797395.171396:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454784 00000100:00100000:0.0:1788797395.171402:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454784 00000100:00100000:0.0:1788797395.171444:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797395.171451:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+10:22789:x1875689390454784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797395.171459:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797395.171468:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce24f expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797395.171484:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 11 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797395.171491:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 11 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797395.171496:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9600, rc 0) 00000100:00100000:0.0:1788797395.171587:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390454784:12345-0@lo:101:mount.lustre.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797395.171591:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797395.171632:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797395.171653:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.171661:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797395.171779:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797395.171898:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.171937:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6f2e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.171959:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390454912 00000100:00100000:2.0:1788797395.171962:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390454912 00000100:00100000:2.0:1788797395.172004:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797395.172009:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390454912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797395.172140:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390454912:12345-0@lo:501:mount.lustre.0 Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.172145:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797395.172238:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390454912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797395.172277:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797395.172311:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.172359:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6f2e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.172430:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455040 00000100:00100000:2.0:1788797395.172433:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455040 00000100:00100000:2.0:1788797395.172455:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797395.172460:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390455040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797395.172522:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390455040:12345-0@lo:503:mount.lustre.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.172526:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797395.172619:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797395.173104:0:22838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22838:1875689390455168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.173130:0:22838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797395.173165:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455168 00000100:00100000:0.0:1788797395.173170:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455168 00000100:00100000:0.0:1788797395.173202:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788797395.173209:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22838:x1875689390455168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.173248:0:22838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797395.174273:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22838:x1875689390455168:12345-0@lo:502:llog_process_th.0 Request processed in 1061us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797395.174292:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788797395.174294:0:22838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22838:1875689390455168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788797395.174319:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797395.174397:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174400:0:22838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788797395.174407:0:22838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a23fc5fe800 00000020:00000080:2.0:1788797395.174409:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797395.174415:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797395.174416:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174417:0:22838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788797395.174419:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797395.174420:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174421:0:22838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788797395.174423:0:22838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a23fc5fe800 00000020:00000080:2.0:1788797395.174424:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797395.174475:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797395.174478:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174480:0:22838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788797395.174482:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797395.174485:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174486:0:22838:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797395.174489:0:22838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a23fc5fe800 00000020:00000080:2.0:1788797395.174491:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797395.174506:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797395.174509:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174510:0:22838:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797395.174512:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797395.174514:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.174515:0:22838:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788797395.174518:0:22838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a23fc5fe800 00000020:00000080:2.0:1788797395.174519:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788797395.174560:0:22838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22838:1875689390455296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.174609:0:22838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.174684:0:22838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788797395.174775:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455296 00000100:00100000:3.0:1788797395.174782:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455296 00000100:00100000:3.0:1788797395.174967:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788797395.174976:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22838:x1875689390455296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797395.175079:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22838:x1875689390455296:12345-0@lo:502:llog_process_th.0 Request processed in 104us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797395.175086:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788797395.175145:0:22838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22838:1875689390455296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788797395.175174:0:22838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797395.175178:0:22838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797395.175179:0:22838:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788797395.175183:0:22838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788797395.175442:0:22789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788797395.175467:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797395.175520:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.175533:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797395.175590:0:22789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788797395.175597:0:22789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a23fc5fe800 10000000:01000000:1.0:1788797395.175601:0:22789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a23fc5fe800 10000000:01000000:1.0:1788797395.175605:0:22789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797395.175610:0:22789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a23fc5fe800 from 1 10000000:01000000:1.0:1788797395.175613:0:22789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788797395.175638:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.175647:0:22789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.175656:0:22789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797395.175671:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797395.175700:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797395.175822:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c82d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797395.175881:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455424 00000100:00100000:3.0:1788797395.175886:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455424 00000100:00100000:3.0:1788797395.175920:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797395.175928:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22789:x1875689390455424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797395.175937:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797395.175948:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401514c00/0x6418c0ce308ce264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce25d expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.175975:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401514c00/0x6418c0ce308ce264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce25d expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.175985:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401514c00/0x6418c0ce308ce264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce25d expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.175994:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514c00, rc 0) 00000100:00100000:3.0:1788797395.176022:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390455424:12345-0@lo:101:mount.lustre.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797395.176028:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797395.176103:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797395.176115:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce264 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.176123:0:22789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce264 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797395.176180:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797395.176204:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797395.176221:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c82d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797395.176312:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455552 00000100:00100000:3.0:1788797395.176316:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455552 00000100:00100000:3.0:1788797395.176410:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797395.176417:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390455552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797395.176511:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390455552:12345-0@lo:501:mount.lustre.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797395.176518:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788797395.176818:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797395.176844:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797395.176886:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797395.176911:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c82d90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797395.177049:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455680 00000100:00100000:1.0:1788797395.177053:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455680 00000100:00100000:1.0:1788797395.177176:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788797395.177185:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390455680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797395.177263:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390455680:12345-0@lo:503:mount.lustre.0 Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797395.177270:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788797395.178272:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390455680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797395.181033:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390455808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.181111:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.181146:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455808 00000100:00100000:2.0:1788797395.181153:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455808 00000100:00100000:2.0:1788797395.181254:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797395.181263:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390455808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.181379:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390455808:12345-0@lo:502:llog_process_th.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.181387:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797395.181436:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.181456:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390455808:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788797395.181513:0:22840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788797395.181527:0:22840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a22c43599c0) 00000020:00000080:2.0:1788797395.181544:0:22840:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788797395.181623:0:22840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23fc5fe800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788797395.181627:0:22840:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23fc5fe800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788797395.181630:0:22840:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23fc5fe800 4 00010000:00080000:2.0:1788797395.181669:0:22840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a240162a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797395.188888:0:22840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788797395.189093:0:22840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788797395.189136:0:22840:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797395.189148:0:22840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6418c0ce308ce272 00000100:00080000:2.0:1788797395.189963:0:22840:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797395.189975:0:22840:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a240162a000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797395.190020:0:22840:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d99880 x1875689390455936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797395.190055:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390455936:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797395.190123:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.191083:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390455936 00000100:00100000:2.0:1788797395.191093:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390455936 00000100:00100000:2.0:1788797395.191124:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797395.191131:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875689390455936:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797395.191210:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875689390455936:12345-0@lo:38:llog_process_th.0 Request processed in 78us (1086us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788797395.191217:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797395.191264:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797395.191272:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a240162a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797395.191287:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788797395.191291:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390455936:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788797395.191316:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788797395.191321:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788797395.191323:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797395.191326:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:2.0:1788797395.191330:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788797395.191336:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797395.191369:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d99880 x1875689390456064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797395.191385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797395.191389:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797395.191392:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797395.191395:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797395.191411:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390456064:0@lo:38:kworker.0 00000100:00100000:2.0:1788797395.191442:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.191481:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456064 00000100:00100000:2.0:1788797395.191485:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456064 00000100:00100000:2.0:1788797395.191502:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797395.191507:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390456064:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788797395.191517:0:22816:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788797395.191545:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390456064:12345-0@lo:38:kworker.0 Request processed in 37us (102us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797395.191551:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797395.191570:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797395.191588:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797395.191592:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390456064:0@lo:38:kworker.0 00000100:00080000:2.0:1788797395.191609:0:22840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788797395.191623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797395.191626:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797395.191629:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797395.191636:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797395.191921:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390456192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.191961:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.191984:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456192 00000100:00100000:2.0:1788797395.191988:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456192 00000100:00100000:2.0:1788797395.192018:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788797395.192024:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390456192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.192116:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390456192:12345-0@lo:502:llog_process_th.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.192123:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788797395.192177:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6dcc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.192190:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390456192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.192235:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390456320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.192263:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797395.192283:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456320 00000100:00100000:2.0:1788797395.192287:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456320 00000100:00100000:2.0:1788797395.192307:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797395.192313:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390456320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797395.192368:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22840:x1875689390456320:12345-0@lo:502:llog_process_th.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.192375:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797395.192407:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6dcc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.192418:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42e4a701-62a9-467c-87db-46cabbbe5ca1:22840:1875689390456320:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788797395.192434:0:22840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788797395.195035:0:22789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788797395.195073:0:22789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788797395.195129:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce264 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.195142:0:22789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402044200/0x6418c0ce308ce25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce264 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788797395.195200:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788797395.195203:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797395.195204:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797395.195205:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797395.195206:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797395.195207:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797395.195209:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797395.195210:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797395.195212:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797395.195213:0:22789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788797395.195217:0:22789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788797395.195325:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788797395.195327:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797395.195333:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797395.195334:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797395.195335:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797395.195336:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797395.195337:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797395.195338:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797395.195340:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797395.195340:0:22789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788797395.195372:0:22789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788797395.195389:0:22789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390456448:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788797395.195448:0:22789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797395.195484:0:22789:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c82d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797395.195991:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456448 00000100:00100000:2.0:1788797395.196000:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456448 00000100:00100000:2.0:1788797395.196039:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797395.196048:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390456448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788797395.196073:0:22804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788797395.196086:0:22804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788797395.198815:0:22804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788797395.198830:0:22804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788797395.198986:0:22826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788797395.198991:0:22826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788797395.199010:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.199024:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.199029:0:22826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.199064:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.199074:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 12 pid: 22803 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797395.199084:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390456576:0@lo:104: 00000100:00100000:3.0:1788797395.199143:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.199186:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6f2e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797395.200319:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456576 00000100:00100000:1.0:1788797395.200806:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456576 00000100:00100000:1.0:1788797395.200861:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797395.200871:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390456576:12345-0@lo:104: 00010000:00010000:1.0:1788797395.200887:0:22793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.200962:0:22793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788797395.200968:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390456576:12345-0@lo:104: Request processed in 100us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797395.200974:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797395.201014:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390456576:0@lo:104: 00010000:00010000:1.0:1788797395.201033:0:22826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201050:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797395.201055:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201062:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ac00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:1.0:1788797395.201074:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201082:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788797395.201090:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797395.201096:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788797395.201126:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201133:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797395.201152:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201159:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce248 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.201174:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797395.201176:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797395.201178:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797395.201207:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390456704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797395.201240:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797395.201431:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456704 00000100:00100000:3.0:1788797395.201436:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456704 00010000:00010000:3.0:1788797395.201456:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 13 pid: 22803 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797395.201477:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797395.201484:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+13:3617:x1875689390456704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797395.201494:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797395.201499:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 13 pid: 22803 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201509:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 13 pid: 22803 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201521:0:22795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce241 expref: 13 pid: 22803 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201534:0:22795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201550:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788797395.201563:0:22795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002572558s 00010000:00010000:3.0:1788797395.201569:0:22795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201587:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201595:0:22795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201601:0:22795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201607:0:22795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797395.201611:0:22795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201618:0:22795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201636:0:22795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797395.201646:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797395.201875:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22789:x1875689390456448:12345-0@lo:253:mount.lustre.0 Request processed in 5827us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797395.201883:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788797395.201956:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:3617:x1875689390456704:12345-0@lo:103:ldlm_bl.0 Request processed in 472us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797395.201963:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797395.201996:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390456704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797395.202588:0:22826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.202598:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797395.202613:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce279 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797395.202646:0:22789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:22789:1875689390456448:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788797395.202657:0:22789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788797395.202662:0:22789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788797395.202663:0:22789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797395.202665:0:22789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797395.202666:0:22789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797395.202667:0:22789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797395.202668:0:22789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797395.202669:0:22789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797395.202670:0:22789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797395.202672:0:22789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797395.202673:0:22789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788797395.202683:0:22789:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1788797395.222457:0:22789:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788797395.224143:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788797395.224243:0:22850:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788797395.224247:0:22850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1788797395.224477:0:22851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788797395.224631:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788797395.225274:0:22851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797395.228155:0:22851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788797395.228236:0:22851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1788797395.229551:0:22852:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a23f90c9880 x1875689390456832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797395.229566:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000040:01000000:3.0:1788797395.230701:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788797395.231309:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788797395.232015:0:22789:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788797395.232026:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788797395.232071:0:22789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797395.233522:0:22789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788797395.234523:0:22789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788797395.234570:0:22789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788797395.235392:0:22789:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788797395.235998:0:22789:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788797395.237268:0:22789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788797395.239110:0:22789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788797395.239139:0:22789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa52981c57988 00100000:10000000:3.0:1788797395.239146:0:22789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788797395.239728:0:22789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788797395.239743:0:22789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788797395.239761:0:22789:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788797395.239782:0:22789:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788797395.241678:0:22789:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797395.241892:0:22789:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797395.699838:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797396.213524:0:22846:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788797396.213533:0:22846:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797396.216460:0:22846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788797396.216474:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788797396.275091:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 10000000:01000000:0.0:1788797396.275169:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788797396.275174:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a23fc5fe800 from 11 10000000:01000000:0.0:1788797396.275178:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797396.275224:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797396.275236:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797396.276188:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797396.276217:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390456960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797396.276296:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797396.276459:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d01a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797396.282116:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456960 00000100:00100000:3.0:1788797396.282131:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456960 00000100:00100000:3.0:1788797396.282207:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788797396.282218:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+11:22807:x1875689390456960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797396.282236:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797396.282268:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce280 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797396.282311:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797396.282333:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797396.282341:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401515e00, rc 0) 00000100:00100000:3.0:1788797396.282431:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22807:x1875689390456960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (6135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797396.282439:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797396.282671:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390456960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797396.282691:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797396.282709:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797396.282775:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390457088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797396.282838:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797396.282869:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797396.284643:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457088 00000100:00100000:0.0:1788797396.284655:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457088 00000100:00100000:0.0:1788797396.284719:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788797396.284729:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22807:x1875689390457088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788797396.284754:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788797396.284770:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788797396.284773:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788797396.284924:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:22807:x1875689390457088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797396.284932:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797396.285049:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390457088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797396.285100:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797396.285110:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797396.285120:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797396.728026:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797397.236509:0:22846:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788797397.236520:0:22846:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797397.237178:0:22846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788797397.237230:0:22846:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797397.237758:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788797397.302412:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797397.747243:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797398.324009:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797398.771279:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797399.348990:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797399.796928:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797400.372634:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000100:00080000:1.0:1788797400.628385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788797400.628393:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788797400.628396:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797400.628404:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:1.0:1788797400.628410:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788797400.628422:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797400.628447:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90cb480 x1875689390457344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797400.628477:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797400.628481:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797400.628484:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797400.628486:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797400.628489:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788797400.628492:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788797400.628494:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a240162a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797400.628513:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a240162a000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797400.628543:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90cbb80 x1875689390457472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797400.628612:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390457216:0@lo:400:kworker.0 00000100:00100000:1.0:1788797400.628696:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797400.628781:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457344:0@lo:38:kworker.0 00000100:00100000:1.0:1788797400.628892:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797400.628913:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390457472:0@lo:38:kworker.0 00000100:00100000:1.0:1788797400.628953:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797400.630160:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457344 00000100:00100000:2.0:1788797400.630172:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457344 00000100:00100000:2.0:1788797400.630212:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797400.630220:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390457344:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788797400.630405:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457216 00000100:00100000:1.0:1788797400.630410:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457216 00000100:00100000:1.0:1788797400.630451:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788797400.630458:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3618:x1875689390457216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797400.630540:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3618:x1875689390457216:12345-0@lo:400:kworker.0 Request processed in 81us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797400.630547:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00020000:2.0:1788797400.630843:0:22816:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788797400.630886:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390457344:12345-0@lo:38:kworker.0 Request processed in 666us (1993us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797400.630893:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797400.630921:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457472 00000100:00100000:2.0:1788797400.630926:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457472 00000100:00100000:2.0:1788797400.630945:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797400.630958:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390457472:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788797400.630974:0:22812:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1788797400.631007:0:22812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6418c0ce308ce28e 00000004:00100000:2.0:1788797400.631023:0:22812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788797400.633690:0:22812:0:(import.c:65:import_set_state_nolock()) ffff9a240162c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797400.633776:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875689390457472:12345-0@lo:38:kworker.0 Request processed in 2815us (4820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797400.633803:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797400.633943:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797400.633948:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797400.633952:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457344:0@lo:38:kworker.0 00010000:00080000:2.0:1788797400.633966:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a23f90cbb80 x1875689390457472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797400.633980:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788797400.633988:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788797400.633993:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797400.633995:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a240162a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797400.634000:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875689390457472:0@lo:38:kworker.0 00000100:00100000:1.0:1788797400.634262:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390457216:0@lo:400:kworker.0 00010000:00010000:0.0:1788797400.818977:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797401.401826:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000001:02000400:3.0:1788797401.574699:0:23095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788797401.843204:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797402.418956:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000020:00000004:0.0:1788797402.759514:0:23148:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797402.759697:0:23148:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797402.867221:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797403.446428:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000020:00000004:3.0:1788797403.881008:0:23198:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797403.881212:0:23198:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788797403.891328:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797404.466869:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:0.0:1788797404.920087:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797405.491744:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000100:00100000:0.0:1788797405.747199:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797395/real 1788797395] req@ffff9a22c41b4700 x1875689390454272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797405.747233:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c41b4700 x1875689390454272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797405.747245:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797395/real 1788797395] req@ffff9a23f90c9180 x1875689390454144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797405.747256:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23f90c9180 x1875689390454144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797405.747274:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797405.747295:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797405.747299:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454272:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788797405.747304:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797405.747309:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797405.747312:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390454144:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788797405.747486:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788797405.747490:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788797405.747493:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797405.747498:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:1.0:1788797405.747503:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788797405.747513:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797405.747533:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c9500 x1875689390457728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797405.747546:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797405.747549:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788797405.747550:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797405.747553:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1788797405.747555:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788797405.747560:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a23efaab000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797405.747570:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90ca680 x1875689390457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797405.747577:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797405.747579:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797405.747581:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797405.747583:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1788797405.747597:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788797405.747602:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797405.747613:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c9c00 x1875689390457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797405.747656:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788797405.747717:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797405.747855:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390457600:0@lo:400:kworker.0 00000100:00100000:2.0:1788797405.747888:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797405.747944:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458112 00000100:00100000:2.0:1788797405.747952:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458112 00000100:00100000:2.0:1788797405.747992:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797405.748001:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390458112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797405.748044:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390458112:12345-0@lo:400:kworker.0 Request processed in 45us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797405.748058:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788797405.748332:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a23f90c8700 x1875689390458112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797405.748344:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390458112:0@lo:400:kworker.0 00000100:00100000:0.0:1788797405.748418:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457600 00000100:00100000:0.0:1788797405.748423:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457600 00000100:00100000:0.0:1788797405.748458:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797405.748466:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3619:x1875689390457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797405.748521:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3619:x1875689390457600:12345-0@lo:400:kworker.0 Request processed in 55us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797405.748528:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797405.748561:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457728:0@lo:38:kworker.0 00000100:00100000:0.0:1788797405.748586:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797405.748609:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457856:0@lo:8:kworker.0 00000400:00000100:0.0:1788797405.748630:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390457856 offset 0 length 520: 4 00000100:00100000:0.0:1788797405.748644:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457984:0@lo:8:kworker.0 00000400:00000100:0.0:1788797405.748661:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390457984 offset 0 length 520: 4 00000100:00100000:0.0:1788797405.748687:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390457728 00000100:00100000:0.0:1788797405.748691:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390457728 00000100:00100000:0.0:1788797405.748709:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797405.748713:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390457728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788797405.748728:0:22816:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797405.748764:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390457728:12345-0@lo:38:kworker.0 Request processed in 49us (176us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797405.748994:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788797405.749027:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797405.749032:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797405.749035:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457728:0@lo:38:kworker.0 00000100:00100000:2.0:1788797405.749158:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390457600:0@lo:400:kworker.0 00010000:00010000:0.0:1788797405.940585:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797406.521213:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797406.965637:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797407.538946:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000040:00080000:0.0:1788797407.540109:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797407.987965:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797408.568961:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:0.0:1788797409.013161:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797409.589690:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:0.0:1788797410.035374:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797410.613514:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000100:00080000:3.0:1788797410.873554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797410.873562:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788797410.873566:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797410.873584:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1788797410.873589:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788797410.873601:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797410.873646:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e6d80 x1875689390458368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797410.873667:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797410.873671:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797410.873674:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797410.873677:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797410.873721:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390458368:0@lo:38:kworker.0 00000100:00100000:3.0:1788797410.873833:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797410.873903:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797410.873910:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390458496:0@lo:400:kworker.0 00000100:00100000:3.0:1788797410.873940:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797410.873972:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458496 00000100:00100000:3.0:1788797410.873981:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458496 00000100:00100000:0.0:1788797410.874187:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797410.874197:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390458240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797410.874230:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797410.874274:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458368 00000100:00100000:0.0:1788797410.874279:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458368 00000100:00100000:0.0:1788797410.874309:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797410.874318:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390458368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788797410.874342:0:22816:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797410.874393:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875689390458368:12345-0@lo:38:kworker.0 Request processed in 75us (559us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797410.874400:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797410.874424:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458240 00000100:00100000:0.0:1788797410.874440:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458240 00000100:00100000:0.0:1788797410.874469:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788797410.874476:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3616:x1875689390458240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797410.874516:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:3616:x1875689390458240:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797410.874522:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788797410.874575:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390458240:0@lo:400:kworker.0 00000100:00080000:0.0:1788797410.874605:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797410.874610:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797410.874613:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390458368:0@lo:38:kworker.0 00000100:00100000:3.0:1788797410.875034:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797410.875048:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390458496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797410.875101:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390458496:12345-0@lo:400:kworker.0 Request processed in 58us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797410.875108:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788797410.875163:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a23d89e6680 x1875689390458496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797410.875329:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390458496:0@lo:400:kworker.0 00010000:00010000:1.0:1788797411.059335:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797411.647636:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000020:01000004:1.0:1788797411.848667:0:23543:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788797411.848671:0:23543:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788797411.848673:0:23543:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788797411.849092:0:23543:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a22c2ff5000 00000020:01000004:1.0:1788797411.849112:0:23543:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788797411.849124:0:23543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788797411.849139:0:23543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a23c41b0000) 00000020:00000080:1.0:1788797411.849157:0:23543:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788797411.955841:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788797411.956115:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788797411.957043:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788797411.957340:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.960027:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.961131:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788797411.961508:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788797411.962746:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788797411.964457:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.965111:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.966074:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788797411.966953:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788797411.967778:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.968735:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788797411.970303:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788797411.970711:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788797411.971131:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788797411.971903:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788797411.972643:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788797411.979624:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788797411.980858:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788797411.981326:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788797411.982066:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788797411.982410:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788797411.982678:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788797411.982896:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.984463:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.984866:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.985073:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.985432:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.985689:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.985956:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.986345:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.986547:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.986842:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.987045:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.987373:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.987635:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.987936:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.988145:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.988763:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.988986:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.989492:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.989936:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788797411.990430:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788797411.990738:0:23543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00080000:01000000:1.0:1788797411.998732:0:23543:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788797411.999047:0:23543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788797411.999059:0:23543:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788797411.999071:0:23543:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce29c 00000020:01000004:1.0:1788797411.999078:0:23543:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788797411.999099:0:23543:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788797411.999102:0:23543:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788797411.999108:0:23543:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788797411.999132:0:23543:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788797411.999136:0:23543:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788797412.006375:0:23543:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788797412.006427:0:23543:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788797412.006432:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788797412.006434:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788797412.006435:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797412.006436:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797412.006437:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797412.006438:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797412.006439:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788797412.006441:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797412.006442:0:23543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788797412.006446:0:23543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788797412.006449:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797412.006450:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788797412.006451:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797412.006452:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797412.006453:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797412.006454:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797412.006455:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788797412.006456:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797412.006457:0:23543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788797412.006485:0:23543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788797412.006507:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797412.006640:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.006781:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d4661b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797412.006867:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458624 00000100:00100000:1.0:1788797412.006877:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458624 00000100:00100000:1.0:1788797412.006971:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797412.006981:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:23543:x1875689390458624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797412.007030:0:22805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788797412.007040:0:22805:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788797412.007048:0:22805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788797412.007391:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:23543:x1875689390458624:12345-0@lo:253:mount.lustre.0 Request processed in 411us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797412.007400:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788797412.007495:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797412.007506:0:23543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788797412.007509:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797412.007511:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788797412.007512:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797412.007513:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797412.007515:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797412.007516:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797412.007517:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788797412.007519:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797412.007520:0:23543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788797412.007539:0:23543:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a22c2ff5000 from lustre-MDT0001 10000000:01000000:2.0:1788797412.007589:0:23543:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788797412.007592:0:23543:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788797412.007598:0:23543:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a23f241b380 local copy 00010000:00010000:2.0:1788797412.007608:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.007691:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.007722:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.008013:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.008114:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458752 00000100:00100000:0.0:1788797412.008120:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458752 00000100:00100000:0.0:1788797412.008149:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788797412.008158:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:23543:x1875689390458752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797412.008254:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:23543:x1875689390458752:12345-0@lo:501:mount.lustre.0 Request processed in 97us (530us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788797412.008269:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797412.008674:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788797412.008698:0:23543:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788797412.008718:0:23543:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788797412.008725:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.008906:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.008941:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a22c2ff5000 10000000:01000000:2.0:1788797412.008946:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788797412.008953:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a23f241b380 10000000:01000000:2.0:1788797412.008956:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788797412.008959:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a23f241b380 from 1 10000000:01000000:2.0:1788797412.008963:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788797412.008989:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.008997:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.009005:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.009021:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797412.009057:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.009077:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.009141:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390458880 00000100:00100000:0.0:1788797412.009147:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390458880 00000100:00100000:0.0:1788797412.009169:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797412.009176:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+12:23543:x1875689390458880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797412.009186:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797412.009199:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9200/0x6418c0ce308ce2aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce2a3 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.009235:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9200/0x6418c0ce308ce2aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce2a3 expref: 13 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.009246:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9200/0x6418c0ce308ce2aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce2a3 expref: 13 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.009255:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9200, rc 0) 00000100:00100000:0.0:1788797412.009338:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+13:23543:x1875689390458880:12345-0@lo:101:mount.lustre.0 Request processed in 162us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.009344:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788797412.009628:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390458880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797412.009642:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2aa expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.009662:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce2aa expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.009678:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788797412.009720:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2aa expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.009729:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084ac00/0x6418c0ce308ce2a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2aa expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.009737:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a22c2ff5000 10000000:01000000:2.0:1788797412.009741:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788797412.009744:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a22c2ff5000 from 1 10000000:01000000:2.0:1788797412.009746:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788797412.009760:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.009766:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.009773:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.009784:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797412.009836:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.009859:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.009928:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459008 00000100:00100000:3.0:1788797412.009933:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459008 00000100:00100000:3.0:1788797412.009965:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797412.009973:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+13:23543:x1875689390459008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797412.009981:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797412.009989:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401515600/0x6418c0ce308ce2b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce2b1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010003:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515600/0x6418c0ce308ce2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce2b1 expref: 14 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010011:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401515600/0x6418c0ce308ce2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce2b1 expref: 14 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010018:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401515600, rc 0) 00000100:00100000:3.0:1788797412.010051:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+14:23543:x1875689390459008:12345-0@lo:101:mount.lustre.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.010057:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788797412.010139:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797412.010149:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2b8 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.010172:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce2b8 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.010183:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788797412.010463:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2b8 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.010472:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084a000/0x6418c0ce308ce2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2b8 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.010479:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788797412.010484:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788797412.010488:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a22c2ff5000 10000000:01000000:2.0:1788797412.010491:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788797412.010494:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788797412.010496:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788797412.010511:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.010518:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.010526:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.010539:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797412.010633:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.010662:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.010723:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459136 00000100:00100000:3.0:1788797412.010729:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459136 00000100:00100000:3.0:1788797412.010763:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788797412.010770:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+14:23543:x1875689390459136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797412.010777:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797412.010816:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401514e00/0x6418c0ce308ce2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce2bf expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010832:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401514e00/0x6418c0ce308ce2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce2bf expref: 15 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010839:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401514e00/0x6418c0ce308ce2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce2bf expref: 15 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.010845:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514e00, rc 0) 00000100:00100000:3.0:1788797412.010870:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459136:12345-0@lo:101:mount.lustre.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.010876:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797412.010981:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797412.010992:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2c6 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.010999:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce2c6 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797412.018763:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788797412.020539:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797412.031278:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788797412.031331:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788797412.031339:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788797412.031347:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788797412.031357:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788797412.031364:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788797412.031371:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788797412.031378:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788797412.031386:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788797412.031395:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788797412.031402:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788797412.031412:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788797412.031436:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788797412.031449:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788797412.031463:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788797412.031476:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788797412.031489:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788797412.031496:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788797412.031503:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788797412.031514:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788797412.031528:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788797412.031540:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788797412.031552:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788797412.031853:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788797412.031861:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788797412.031868:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788797412.031875:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788797412.031882:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788797412.031889:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788797412.031897:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788797412.031903:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788797412.031911:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788797412.031918:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788797412.031924:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788797412.031931:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788797412.031937:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788797412.031944:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788797412.031950:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788797412.031957:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788797412.031964:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788797412.031970:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788797412.031976:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788797412.031983:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788797412.031989:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788797412.032068:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788797412.032073:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788797412.032175:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.032244:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.032366:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.035353:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459264 00000100:00100000:0.0:1788797412.035369:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459264 00000100:00100000:0.0:1788797412.035496:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788797412.035507:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797412.035749:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459264:12345-0@lo:501:mount.lustre.0 Request processed in 243us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.035758:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797412.035849:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.035910:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797412.035967:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.040191:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a2401480cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.040486:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459392 00000100:00100000:3.0:1788797412.040498:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459392 00000100:00100000:3.0:1788797412.040550:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788797412.044870:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797412.046234:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459392:12345-0@lo:503:mount.lustre.0 Request processed in 5658us (10247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.046248:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788797412.050192:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788797412.050946:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788797412.051054:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797412.051148:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.051203:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2471e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.051967:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459520 00000100:00100000:2.0:1788797412.051976:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459520 00000100:00100000:2.0:1788797412.052093:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788797412.052103:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.054130:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459520:12345-0@lo:502:mount.lustre.0 Request processed in 2022us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.054140:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788797412.054347:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797412.054673:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788797412.054709:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788797412.054723:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788797412.054735:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788797412.054746:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788797412.054759:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788797412.054772:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788797412.054809:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788797412.054824:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788797412.054831:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788797412.054838:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788797412.054844:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788797412.054851:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788797412.054857:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788797412.054864:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788797412.054870:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788797412.054878:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788797412.054884:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788797412.054891:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788797412.054897:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788797412.054904:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788797412.054910:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788797412.054917:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788797412.054924:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788797412.054930:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788797412.054937:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788797412.054943:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788797412.054958:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788797412.054965:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788797412.054972:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788797412.054978:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788797412.054985:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788797412.054991:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788797412.055109:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788797412.055119:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788797412.055126:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788797412.055132:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788797412.055139:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788797412.055146:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788797412.055152:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788797412.055159:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788797412.056350:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788797412.056367:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788797412.056374:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788797412.056426:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797412.056515:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.056630:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2471e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797412.056839:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459648 00000100:00100000:1.0:1788797412.056848:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459648 00000100:00100000:1.0:1788797412.056903:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788797412.056915:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797412.057057:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390459648:12345-0@lo:502:mount.lustre.0 Request processed in 145us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797412.057065:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788797412.057294:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390459648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.057347:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788797412.057357:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788797412.058596:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797412.058609:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797412.058611:0:23547:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788797412.058617:0:23547:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788797412.058619:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797412.058633:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a22c3bab380) 00000020:00000080:3.0:1788797412.058656:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788797412.058662:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788797412.058733:0:23547:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788797412.058740:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce2d4 00000020:00000080:3.0:1788797412.058986:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788797412.058991:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797412.058994:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797412.059008:0:23547:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788797412.059011:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797412.059015:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797412.059016:0:23547:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788797412.059019:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797412.059026:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a22c3ba99c0) 00000020:00000080:3.0:1788797412.059036:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788797412.059040:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788797412.059041:0:23547:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788797412.059044:0:23547:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788797412.059049:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788797412.059090:0:23547:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a22c2ff5000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788797412.059100:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a22c3ba8000) 00000020:00000080:3.0:1788797412.059108:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788797412.059318:0:23547:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788797412.059325:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce2e9 00000020:00000080:3.0:1788797412.059406:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788797412.059412:0:23547:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788797412.059426:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6418c0ce308ce2f0 00080000:01000000:3.0:1788797412.059432:0:23547:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788797412.059441:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce2f7 00010000:00010000:1.0:1788797412.086660:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797412.170775:0:23547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788797412.174870:0:23547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788797412.175721:0:23547:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788797412.180729:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788797412.180743:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797412.180751:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.180753:0:23547:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788797412.180758:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797412.180764:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.180766:0:23547:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788797412.180769:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788797412.180775:0:23547:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:00000080:2.0:1788797412.180819:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797412.180836:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a22c435b380) 00000020:00000080:2.0:1788797412.180862:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788797412.180868:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788797412.180956:0:23547:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788797412.180969:0:23547:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788797412.180976:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce305 00010000:00080000:2.0:1788797412.181017:0:23547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23c4164000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797412.187294:0:23547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788797412.189076:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788797412.189090:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788797412.189123:0:23547:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788797412.189142:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce30c 00000100:00080000:2.0:1788797412.189151:0:23547:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797412.190183:0:23547:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a23c4164000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797412.190240:0:23547:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d99880 x1875689390459776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797412.190272:0:23547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788797412.190360:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797412.190365:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190367:0:23547:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788797412.190370:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797412.190372:0:23547:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788797412.190374:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797412.190375:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797412.190376:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797412.190379:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190380:0:23547:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797412.190382:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797412.190386:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190387:0:23547:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788797412.190392:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788797412.190442:0:23547:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788797412.190457:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797412.190460:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190462:0:23547:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788797412.190475:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797412.190476:0:23547:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788797412.190478:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797412.190479:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797412.190480:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797412.190482:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190484:0:23547:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797412.190486:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788797412.190489:0:23547:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788797412.190491:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797412.190493:0:23547:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788797412.190495:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788797412.190499:0:23547:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:2.0:1788797412.190521:0:23547:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788797412.190524:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797412.190537:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a22c4358000) 00000020:00000080:2.0:1788797412.190551:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788797412.190567:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788797412.190626:0:23547:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788797412.190634:0:23547:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788797412.190641:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce31a 00010000:00080000:2.0:1788797412.190672:0:23547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a22c3844000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797412.190953:0:23547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788797412.191336:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788797412.191341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788797412.191344:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797412.191350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 670 00000100:00080000:0.0:1788797412.191354:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788797412.191361:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797412.191378:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c41b7b80 x1875689390460032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797412.191390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797412.191400:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797412.191402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797412.191405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797412.191476:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390459904:0@lo:400:kworker.0 00000100:00100000:0.0:1788797412.191543:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.191613:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390460160:0@lo:400:kworker.0 00000100:00100000:0.0:1788797412.191643:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.194800:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459904 00000100:00100000:2.0:1788797412.194819:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459904 00000100:00100000:2.0:1788797412.194892:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797412.194903:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:3619:x1875689390459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797412.195701:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:3619:x1875689390459904:12345-0@lo:400:kworker.0 Request processed in 96us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.195711:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797412.195764:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460160 00000100:00100000:2.0:1788797412.195782:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460160 00000100:00100000:2.0:1788797412.195844:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.195852:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797412.195907:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390460160:12345-0@lo:400:kworker.0 Request processed in 56us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.195913:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788797412.195959:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a22c41b4e00 x1875689390460160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797412.195974:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788797412.196017:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390459904:0@lo:400:kworker.0 00000040:01000000:2.0:1788797412.198392:0:23547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788797412.198992:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788797412.199827:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390459776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797412.199902:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797412.199950:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390460032:0@lo:38:kworker.0 00000100:00100000:3.0:1788797412.199971:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.200939:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390459776 00000100:00100000:2.0:1788797412.200952:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390459776 00000100:00100000:2.0:1788797412.200982:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460032 00000100:00100000:2.0:1788797412.200985:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460032 00000100:00100000:2.0:1788797412.201009:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797412.201017:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390459776:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797412.201043:0:22815:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:2.0:1788797412.201082:0:22815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce321 00000004:00100000:2.0:1788797412.201097:0:22815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788797412.201103:0:22815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1788797412.209097:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797412.214399:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788797412.216010:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:0.0:1788797412.216339:0:22815:0:(import.c:65:import_set_state_nolock()) ffff9a22c4a9f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797412.216468:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875689390459776:12345-0@lo:38:llog_process_th.0 Request processed in 15448us (16562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.216480:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797412.216508:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797412.216515:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390460032:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788797412.216558:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390460032:12345-0@lo:38:kworker.0 Request processed in 43us (16585us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788797412.216564:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797412.216830:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797412.216840:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788797412.216849:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788797412.216855:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788797412.216858:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c4164000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788797412.216868:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390459776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797412.216880:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797412.216884:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797412.216887:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788797412.216889:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390460032:0@lo:38:kworker.0 00000100:00100000:0.0:1788797412.216913:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797412.216926:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390460288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797412.216970:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.217008:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460288 00000100:00100000:0.0:1788797412.217014:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460288 00000100:00100000:0.0:1788797412.217058:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797412.217065:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875689390460288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797412.217094:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797412.217187:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875689390460288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.217203:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797412.217236:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390460288:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788797412.219203:0:23552:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788797412.219211:0:23552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788797412.229225:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788797412.229242:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797412.229291:0:23547:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788797412.229313:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce328 00000100:00080000:1.0:1788797412.229323:0:23547:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797412.229336:0:23547:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a22c3844000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797412.229380:0:23547:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c8700 x1875689390460416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797412.229529:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390460416:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788797412.229584:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390460416 offset 0 length 520: 4 00000100:00080000:1.0:1788797412.229751:0:23547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788797412.229831:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.229836:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.229838:0:23547:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788797412.229841:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788797412.229844:0:23547:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788797412.229845:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797412.229847:0:23547:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797412.229862:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788797412.229865:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.229866:0:23547:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788797412.229869:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788797412.229874:0:23547:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788797412.229877:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.229878:0:23547:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788797412.229881:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788797412.229885:0:23547:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.133@tcp to nid 0x20000c0a8ca85 (192.168.202.133@tcp) 00000020:01000000:1.0:1788797412.229905:0:23547:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788797412.229907:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797412.229920:0:23547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a23c41b19c0) 00000020:00000080:1.0:1788797412.229932:0:23547:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788797412.229937:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788797412.230002:0:23547:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788797412.230011:0:23547:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788797412.230017:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6418c0ce308ce336 00010000:00080000:1.0:1788797412.230047:0:23547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23f2a64000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1788797412.230427:0:23547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788797412.230499:0:23547:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788797412.230516:0:23547:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788797412.230903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.230909:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797412.230919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.230922:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788797412.232526:0:23547:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797412.232722:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788797412.233389:0:23547:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1788797412.234575:0:23554:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788797412.234582:0:23554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788797412.235655:0:23547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788797412.235668:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797412.235708:0:23547:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788797412.235731:0:23547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce33d 00000100:00080000:1.0:1788797412.235742:0:23547:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797412.235753:0:23547:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797412.236311:0:23547:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90c8000 x1875689390460544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797412.236399:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390460544:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788797412.236540:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390460544 offset 0 length 520: 4 00000100:00080000:1.0:1788797412.236640:0:23547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788797412.236706:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.236711:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.236713:0:23547:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788797412.236716:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.236720:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.236721:0:23547:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788797412.236724:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788797412.236726:0:23547:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788797412.236728:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.236730:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.236732:0:23547:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788797412.236735:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.236737:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.236738:0:23547:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788797412.236742:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788797412.236779:0:23547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.236781:0:23547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.236782:0:23547:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788797412.236813:0:23547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1788797412.237052:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.237058:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797412.237061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.237064:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788797412.237084:0:23543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788797412.237123:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788797412.237148:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2c6 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.237170:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084a600/0x6418c0ce308ce2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce2c6 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.237180:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a22c2ff5000 from 1 10000000:01000000:2.0:1788797412.237182:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797412.237210:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.237227:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.237238:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.237255:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797412.237294:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.237328:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.237714:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460672 00000100:00100000:0.0:1788797412.237722:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460672 00000100:00100000:0.0:1788797412.238181:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788797412.238192:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+15:23543:x1875689390460672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797412.238206:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797412.238229:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce344 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.238253:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 16 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.238263:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 16 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797412.238272:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e8400, rc 0) 00000100:00100000:0.0:1788797412.238315:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:23543:x1875689390460672:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.238322:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797412.238399:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797412.238431:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.238440:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797412.239006:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460800:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788797412.239050:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797412.239660:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d849ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.239749:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460800 00000100:00100000:2.0:1788797412.239755:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460800 00000100:00100000:2.0:1788797412.239813:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788797412.239820:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:23543:x1875689390460800:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788797412.239837:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788797412.239857:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788797412.239860:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788797412.239937:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:23543:x1875689390460800:12345-0@lo:256:mount.lustre.0 Request processed in 118us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.239944:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797412.240505:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460800:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788797412.241212:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797412.241253:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.241266:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797412.241275:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a22c2ff5000 from 1 10000000:01000000:3.0:1788797412.241278:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797412.241318:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.241326:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.241336:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797412.241361:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797412.241423:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797412.241466:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d849ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.241640:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390460928 00000100:00100000:2.0:1788797412.241647:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390460928 00000100:00100000:2.0:1788797412.241695:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788797412.241704:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:23543:x1875689390460928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797412.241717:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797412.241733:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce352 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.241756:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.241769:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.241777:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084b000, rc 0) 00000100:00100000:2.0:1788797412.241838:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390460928:12345-0@lo:101:mount.lustre.0 Request processed in 135us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.241844:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797412.242200:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390460928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797412.242235:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.242245:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797412.244916:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788797412.245346:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797412.245642:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788797412.245667:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788797412.245683:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788797412.245699:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788797412.245714:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788797412.245729:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788797412.245742:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788797412.245772:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788797412.246503:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788797412.246534:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788797412.246549:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788797412.246571:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788797412.246576:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788797412.246672:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797412.246743:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797412.246909:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d849e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.250246:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461056 00000100:00100000:2.0:1788797412.250262:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461056 00000100:00100000:3.0:1788797412.252731:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788797412.252746:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797412.252984:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461056:12345-0@lo:501:mount.lustre.0 Request processed in 241us (6240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.252991:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797412.253140:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.253240:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797412.253286:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.253363:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.253493:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461184 00000100:00100000:3.0:1788797412.253499:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461184 00000100:00100000:3.0:1788797412.253532:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788797412.253539:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797412.253670:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461184:12345-0@lo:503:mount.lustre.0 Request processed in 131us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.253678:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788797412.253900:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797412.254584:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797412.254676:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.254722:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.254837:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.254919:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461312 00000100:00100000:3.0:1788797412.254925:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461312 00000100:00100000:3.0:1788797412.255076:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788797412.255085:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797412.255303:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461312:12345-0@lo:502:mount.lustre.0 Request processed in 217us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.255310:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788797412.255713:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.256044:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788797412.256070:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788797412.256078:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788797412.256085:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788797412.256103:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788797412.256111:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788797412.256118:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788797412.256124:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788797412.256133:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788797412.256146:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788797412.256232:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788797412.256262:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.256306:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.256342:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72180 going to sleep for 11 seconds 00000100:00100000:1.0:1788797412.256493:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461440 00000100:00100000:1.0:1788797412.256499:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461440 00000100:00100000:1.0:1788797412.256545:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788797412.256554:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797412.256647:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461440:12345-0@lo:502:mount.lustre.0 Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797412.256654:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788797412.256731:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.256773:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788797412.256780:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788797412.257645:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.257657:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257660:0:23556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788797412.257676:0:23556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a22c2ff5000 00000020:00000080:1.0:1788797412.257679:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797412.257686:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.257689:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257690:0:23556:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788797412.257693:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.257695:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257697:0:23556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788797412.257700:0:23556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a22c2ff5000 00000020:00000080:1.0:1788797412.257702:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797412.257755:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.257758:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257760:0:23556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788797412.257762:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.257765:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257766:0:23556:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788797412.257770:0:23556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a22c2ff5000 00000020:00000080:1.0:1788797412.257772:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797412.257875:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.257879:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257881:0:23556:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788797412.257883:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797412.257885:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257886:0:23556:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788797412.257889:0:23556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a22c2ff5000 00000020:00000080:1.0:1788797412.257891:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797412.257912:0:23556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797412.257915:0:23556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797412.257916:0:23556:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788797412.257919:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1788797412.258149:0:23543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788797412.258299:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797412.258353:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.258366:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.258485:0:23543:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788797412.258488:0:23543:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a22c2ff5000 10000000:01000000:2.0:1788797412.258491:0:23543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a22c2ff5000 10000000:01000000:2.0:1788797412.258496:0:23543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788797412.258501:0:23543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a22c2ff5000 from 1 10000000:01000000:2.0:1788797412.258504:0:23543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788797412.258535:0:23543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.258544:0:23543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.258553:0:23543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.258573:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797412.258626:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.258712:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.258768:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461568 00000100:00100000:3.0:1788797412.258774:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461568 00000100:00100000:3.0:1788797412.258931:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788797412.258940:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:23543:x1875689390461568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797412.258954:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797412.258967:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401514800/0x6418c0ce308ce367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce360 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.258988:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401514800/0x6418c0ce308ce367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce360 expref: 18 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.259072:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401514800/0x6418c0ce308ce367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce360 expref: 18 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.259091:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514800, rc 0) 00000100:00100000:3.0:1788797412.259130:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461568:12345-0@lo:101:mount.lustre.0 Request processed in 191us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.259137:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788797412.259590:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797412.259618:0:23543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce367 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.259628:0:23543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce367 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797412.260987:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788797412.261535:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797412.261716:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788797412.261739:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788797412.261753:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788797412.261767:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788797412.261781:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788797412.261823:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788797412.261838:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788797412.261851:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788797412.261863:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788797412.261876:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788797412.261888:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788797412.261900:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788797412.261912:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788797412.261924:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788797412.261937:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788797412.261949:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788797412.261973:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788797412.261987:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788797412.266817:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788797412.266861:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788797412.266877:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788797412.266890:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788797412.266903:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788797412.266926:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788797412.266940:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788797412.266954:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788797412.266967:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788797412.266979:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788797412.266990:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788797412.267003:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788797412.267016:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788797412.267028:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788797412.267055:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788797412.267071:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788797412.267085:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788797412.267096:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788797412.267107:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788797412.267119:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788797412.267132:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788797412.267143:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788797412.267154:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788797412.267166:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788797412.267180:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788797412.267193:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788797412.267205:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788797412.267218:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788797412.267232:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788797412.267245:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788797412.267442:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788797412.267462:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788797412.267478:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788797412.267483:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788797412.267598:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.267674:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.267725:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461696 00000100:00100000:2.0:1788797412.267736:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461696 00000100:00100000:2.0:1788797412.267784:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797412.267808:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.267922:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461696:12345-0@lo:501:mount.lustre.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.267929:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797412.267971:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.267992:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797412.268022:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797412.268057:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.268079:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461824 00000100:00100000:2.0:1788797412.268084:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461824 00000100:00100000:2.0:1788797412.268107:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788797412.268113:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797412.268188:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461824:12345-0@lo:503:mount.lustre.0 Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.268194:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788797412.268229:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.268241:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797412.269206:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797412.269425:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.269477:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.269553:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797412.269592:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390461952 00000100:00100000:3.0:1788797412.269599:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390461952 00000100:00100000:3.0:1788797412.269670:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788797412.269679:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797412.269773:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390461952:12345-0@lo:502:mount.lustre.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797412.269781:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788797412.269884:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390461952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.270043:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788797412.270076:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788797412.270091:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788797412.270105:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788797412.270118:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788797412.270131:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788797412.270144:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788797412.270156:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788797412.270170:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788797412.270183:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788797412.270210:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788797412.270241:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788797412.270254:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788797412.270266:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788797412.270278:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788797412.270291:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788797412.270303:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788797412.270315:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788797412.270326:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788797412.270340:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788797412.270350:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788797412.270361:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788797412.270372:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788797412.270386:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788797412.270400:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788797412.270423:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788797412.270449:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788797412.270464:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788797412.270477:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788797412.270487:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788797412.270498:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788797412.270508:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788797412.270519:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788797412.270530:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788797412.270551:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788797412.270564:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788797412.270577:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788797412.270591:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788797412.270604:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788797412.270616:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788797412.270628:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788797412.270641:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788797412.270665:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788797412.270678:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788797412.270689:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788797412.270701:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788797412.270712:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788797412.270725:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788797412.270756:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.270818:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.270853:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462080 00000100:00100000:2.0:1788797412.270859:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462080 00000100:00100000:2.0:1788797412.270888:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788797412.270895:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390462080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.270985:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390462080:12345-0@lo:502:mount.lustre.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.270992:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788797412.271037:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.271051:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.271175:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788797412.271196:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788797412.271214:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.271251:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.271270:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462208 00000100:00100000:2.0:1788797412.271274:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462208 00000100:00100000:2.0:1788797412.271295:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788797412.271301:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390462208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797412.271351:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390462208:12345-0@lo:502:mount.lustre.0 Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.271358:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788797412.271386:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.271395:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797412.271440:0:23543:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1788797412.271447:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788797412.275269:0:23561:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788797412.275287:0:23561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a22c435cd40) 00000020:00000080:2.0:1788797412.275306:0:23561:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788797412.275389:0:23561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a22c2ff5000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788797412.275392:0:23561:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a22c2ff5000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788797412.275394:0:23561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a22c2ff5000 3 00010000:00080000:2.0:1788797412.275434:0:23561:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23f246c000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797412.276727:0:23561:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788797412.276895:0:23561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788797412.276922:0:23561:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797412.276930:0:23561:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6418c0ce308ce375 00000100:00080000:2.0:1788797412.276938:0:23561:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797412.276946:0:23561:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a23f246c000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797412.276975:0:23561:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d9ad80 x1875689390462336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797412.277030:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390462336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797412.277092:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.277144:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462336 00000100:00100000:2.0:1788797412.277149:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462336 00000100:00100000:2.0:1788797412.277176:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.277183:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875689390462336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797412.277208:0:22811:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:2.0:1788797412.277237:0:22811:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6418c0ce308ce37c 00000004:00100000:2.0:1788797412.277252:0:22811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788797412.277279:0:22811:0:(import.c:65:import_set_state_nolock()) ffff9a22c33fb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797412.277319:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875689390462336:12345-0@lo:38:llog_process_th.0 Request processed in 136us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.277325:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788797412.277355:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a22c2d9ad80 x1875689390462336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797412.277362:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797412.277368:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788797412.277373:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788797412.277375:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797412.277377:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f246c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797412.277380:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875689390462336:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788797412.277392:0:23561:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788797412.277409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.277426:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797412.277435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797412.277438:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788797412.292473:0:23561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788797412.296883:0:23543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788797412.296936:0:23543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788797412.296960:0:23543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce367 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.296973:0:23543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084aa00/0x6418c0ce308ce360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce367 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788797412.297026:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788797412.297029:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788797412.297030:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797412.297031:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797412.297032:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797412.297034:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797412.297035:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788797412.297037:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797412.297038:0:23543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788797412.297042:0:23543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788797412.297044:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788797412.297045:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788797412.297047:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797412.297048:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797412.297049:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797412.297050:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797412.297051:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788797412.297052:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797412.297053:0:23543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788797412.297083:0:23543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788797412.297104:0:23543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788797412.297174:0:23543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.297363:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462464 00000100:00100000:2.0:1788797412.297371:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462464 00000100:00100000:2.0:1788797412.297427:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788797412.297436:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:23543:x1875689390462464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788797412.297461:0:22803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788797412.297474:0:22803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788797412.297763:0:23543:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23efa72180 going to sleep for 11 seconds 00000001:00100000:3.0:1788797412.301844:0:22790:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788797412.302613:0:22803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788797412.302632:0:22803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788797412.302977:0:22826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788797412.302982:0:22826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788797412.303011:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303031:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303039:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 18 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303046:0:22826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303082:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 18 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303108:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 18 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797412.303122:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390462592:0@lo:104: 00000100:00100000:3.0:1788797412.303187:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797412.303406:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.303435:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797412.303444:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390462720:0@lo:104: 00000100:00100000:3.0:1788797412.303467:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797412.303485:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c33433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.304068:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462592 00000100:00100000:2.0:1788797412.304077:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462592 00000100:00100000:2.0:1788797412.304108:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462720 00000100:00100000:2.0:1788797412.304111:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462720 00000100:00100000:2.0:1788797412.304125:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797412.304134:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390462592:12345-0@lo:104: 00010000:00010000:2.0:1788797412.304147:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304208:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797412.304214:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390462592:12345-0@lo:104: Request processed in 82us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.304381:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797412.304399:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.304406:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390462720:12345-0@lo:104: 00010000:00010000:2.0:1788797412.304423:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304460:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797412.304466:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390462720:12345-0@lo:104: Request processed in 61us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.304479:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.304522:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390462592:0@lo:104: 00000100:00100000:2.0:1788797412.304532:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390462720:0@lo:104: 00010000:00010000:2.0:1788797412.304556:0:22826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304576:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797412.304582:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304589:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a200 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797412.304593:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304601:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797412.304608:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.304613:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788797412.304642:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304649:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797412.304671:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304679:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084a200/0x6418c0ce308ce344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce34b expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304699:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797412.304702:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304708:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e9800 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797412.304711:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304718:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797412.304724:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797412.304729:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788797412.304743:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304748:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797412.304754:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304761:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9800/0x6418c0ce308ce280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce287 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.304774:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797412.304776:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797412.304777:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797412.304784:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797412.304839:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390462848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797412.304877:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.304900:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797412.304906:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390462976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797412.304926:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797412.304968:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462848 00000100:00100000:2.0:1788797412.304974:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462848 00010000:00010000:2.0:1788797412.305068:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 19 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.305092:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390462976 00000100:00100000:2.0:1788797412.305095:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390462976 00010000:00010000:2.0:1788797412.305109:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 20 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797412.305120:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797412.305126:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:3618:x1875689390462848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797412.305137:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797412.305142:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 20 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305152:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 20 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305166:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e8400/0x6418c0ce308ce34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce344 expref: 20 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305176:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797412.305205:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:3618:x1875689390462848:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.305650:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797412.305667:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.305674:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3618:x1875689390462976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797412.305683:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797412.305688:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305699:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305708:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401515e00/0x6418c0ce308ce287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce280 expref: 18 pid: 22805 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305720:0:22796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305728:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788797412.305744:0:22796:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002762759s 00010000:00010000:2.0:1788797412.305749:0:22796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305757:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305764:0:22796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305771:0:22796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305783:0:22796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797412.305895:0:22796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305904:0:22796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305917:0:22796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797412.305926:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797412.305959:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:3618:x1875689390462976:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.305966:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797412.306041:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390462976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797412.306049:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390462848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797412.306114:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:23543:x1875689390462464:12345-0@lo:253:mount.lustre.0 Request processed in 8680us (8940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.306122:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788797412.306163:0:23543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:23543:1875689390462464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797412.306174:0:23543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788797412.306178:0:23543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797412.306179:0:23543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788797412.306180:0:23543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797412.306181:0:23543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797412.306182:0:23543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797412.306183:0:23543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797412.306184:0:23543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788797412.306195:0:23543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797412.306196:0:23543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788797412.306210:0:23543:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788797412.306942:0:22826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.306955:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797412.306962:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401515800/0x6418c0ce308ce383 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788797412.322434:0:23543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788797412.322592:0:23567:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788797412.322597:0:23567:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788797412.331754:0:23569:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788797412.332188:0:23569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788797412.333131:0:23543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788797412.334444:0:23570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.334515:0:23570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.334567:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463104 00000100:00100000:0.0:1788797412.334575:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463104 00000100:00100000:0.0:1788797412.334623:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797412.334632:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.334705:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797412.334713:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797412.334736:0:23570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.334759:0:23570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463104:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788797412.334809:0:23570:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788797412.334834:0:23570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.334861:0:23570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.334880:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463232 00000100:00100000:0.0:1788797412.334883:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463232 00000100:00100000:0.0:1788797412.334897:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797412.334903:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.334990:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (127us total) trans 0 rc 0/0 00000040:01000000:3.0:1788797412.335519:0:23543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788797412.335561:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797412.337693:0:23569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788797412.337825:0:23569:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788797412.338041:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797412.338084:0:23570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797412.338124:0:23570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.338221:0:23570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23570:1875689390463360:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.338281:0:23570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.338311:0:23570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c37756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797412.338474:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463360 00000100:00100000:2.0:1788797412.338482:0:22821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463360 00000100:00100000:2.0:1788797412.338517:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797412.338525:0:22821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23570:x1875689390463360:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788797412.338584:0:22821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23570:x1875689390463360:12345-0@lo:900:lod0001_rec0000.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.338591:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788797412.338709:0:23570:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a22c41b5c00 x1875689390463360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797428 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797412.338734:0:23570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23570:1875689390463360:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.338780:0:23570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797412.338836:0:23570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797412.338855:0:23570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3775a80 going to sleep for 11 seconds 00000004:00000080:3.0:1788797412.338909:0:23543:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788797412.338925:0:23543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1788797412.339426:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463488 00000100:00100000:2.0:1788797412.339433:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463488 00000100:00100000:2.0:1788797412.339469:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797412.339477:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463488:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788797412.339570:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23570:x1875689390463488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797412.339576:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797412.339610:0:23570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23570:1875689390463488:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788797412.339655:0:23570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797412.340122:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797412.341912:0:23543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788797412.344461:0:23543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788797412.344580:0:23543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788797412.344765:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797412.347640:0:23570:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788797412.347732:0:23570:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788797412.347737:0:23570:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1788797412.348460:0:23543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1788797412.351564:0:23543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788797412.368515:0:23543:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788797412.368559:0:23543:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa52980d87988 00100000:10000000:3.0:1788797412.368568:0:23543:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788797412.369395:0:23543:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788797412.369440:0:23543:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788797412.369465:0:23543:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788797412.369483:0:23543:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788797412.376591:0:23543:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797412.376880:0:23543:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788797412.659497:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:2.0:1788797413.106991:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797413.370508:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788797413.691718:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 10000000:01000000:2.0:1788797413.755249:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788797413.755259:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a22c2ff5000 from 12 10000000:01000000:2.0:1788797413.755265:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797413.755337:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797413.755350:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797413.755362:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797413.755391:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797413.755478:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797413.755539:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c2af70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797413.757513:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463616 00000100:00100000:1.0:1788797413.757531:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463616 00000100:00100000:1.0:1788797413.757592:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788797413.757601:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:22807:x1875689390463616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797413.757620:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797413.757653:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce38a expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.757684:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 17 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.757696:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 17 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.757706:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2402044000, rc 0) 00000100:00100000:1.0:1788797413.757803:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390463616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797413.757811:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788797413.757882:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797413.757901:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.757912:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797413.757980:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797413.758029:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797413.758064:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f909e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797413.758081:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463744 00000100:00100000:1.0:1788797413.758085:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463744 00000100:00100000:1.0:1788797413.758110:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788797413.758117:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390463744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797413.758132:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797413.758151:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797413.758154:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788797413.758233:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390463744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797413.758240:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788797413.758346:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797413.758392:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797413.763361:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763383:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797413.763397:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788797413.763410:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a23fc5fe800 from 12 10000000:01000000:1.0:1788797413.763413:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788797413.763462:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763471:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763503:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797413.763532:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797413.763617:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797413.763655:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f909e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797413.763689:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390463872 00000100:00100000:1.0:1788797413.763697:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390463872 00000100:00100000:1.0:1788797413.763752:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788797413.763761:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390463872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797413.763775:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797413.763808:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce398 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763853:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 18 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763867:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 18 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.763877:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2402045800, rc 0) 00000100:00100000:1.0:1788797413.763917:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390463872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797413.763924:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788797413.763977:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390463872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797413.764624:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797413.764646:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797413.764705:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390464000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797413.764752:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797413.764777:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c4646000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797413.764820:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464000 00000100:00100000:1.0:1788797413.766277:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464000 00000100:00100000:1.0:1788797413.766349:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788797413.766360:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390464000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797413.766388:0:22804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797413.766422:0:22804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797413.766426:0:22804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788797413.767015:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390464000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 654us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797413.767025:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797413.773218:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390464000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788797413.773288:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797413.773299:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797413.773310:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797414.132010:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797414.390770:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797414.712112:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797415.154992:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797415.731626:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00010000:00010000:1.0:1788797416.178999:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797416.761048:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 0 seconds 00000001:02000400:0.0:1788797417.084422:0:23813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788797417.203955:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797417.522986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788797417.522993:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788797417.522997:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797417.523014:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a23ff58f000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797417.523040:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d98380 x1875689390464256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797417.523061:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797417.523065:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797417.523067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797417.523070:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797417.523096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797417.523308:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797417.523312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797417.523315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797417.523406:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390464512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.523468:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797417.523503:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797417.523509:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.523532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797417.523565:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464512 00000100:00100000:2.0:1788797417.523572:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464512 00000100:00100000:2.0:1788797417.523783:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797417.523828:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390464512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.523887:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390464512:12345-0@lo:400:kworker.0 Request processed in 61us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797417.523894:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797417.523918:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464640 00000100:00100000:2.0:1788797417.523922:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464640 00000100:00100000:2.0:1788797417.524010:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797417.524018:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390464640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.524049:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390464640:12345-0@lo:400:kworker.0 Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797417.524055:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797417.524084:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390464256:0@lo:38:kworker.0 00000100:00100000:2.0:1788797417.524109:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797417.524305:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390464384:0@lo:400:kworker.0 00000100:00100000:3.0:1788797417.524333:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797417.524354:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797417.524360:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390464128:0@lo:400:kworker.0 00000100:00100000:3.0:1788797417.524399:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797417.524442:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464128 00000100:00100000:3.0:1788797417.524455:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464128 00000100:00100000:3.0:1788797417.524484:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797417.524490:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3617:x1875689390464128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797417.524524:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3617:x1875689390464128:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797417.524530:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797417.524574:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.525808:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464384 00000100:00100000:2.0:1788797417.525825:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464384 00000100:00100000:2.0:1788797417.525862:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797417.525869:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390464384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.525922:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390464384:12345-0@lo:400:kworker.0 Request processed in 54us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797417.525931:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788797417.526078:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c2d99500 x1875689390464384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797417.526092:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390464384:0@lo:400:kworker.0 00010000:00080000:2.0:1788797417.526416:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c2d98000 x1875689390464640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797417.526425:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.526435:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390464512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797417.527078:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797417.527088:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390464768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797417.527287:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464256 00000100:00100000:3.0:1788797417.527294:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464256 00000100:00100000:3.0:1788797417.527320:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797417.527326:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3615:x1875689390464256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788797417.527352:0:22815:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 677 last 0 00000020:00000080:3.0:1788797417.527398:0:22815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce3a6 00000004:00100000:3.0:1788797417.527411:0:22815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788797417.527417:0:22815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788797417.527540:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797417.527629:0:22816:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788797417.527637:0:22816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788797417.529859:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464768 00000100:00100000:2.0:1788797417.529873:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464768 00000100:00100000:3.0:1788797417.530174:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797417.530196:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390464768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797417.530237:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797417.530331:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390464768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797417.530337:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797417.531097:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390464768:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788797417.540201:0:22815:0:(import.c:65:import_set_state_nolock()) ffff9a23efaa5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797417.540315:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875689390464256:12345-0@lo:38:kworker.0 Request processed in 12986us (16202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797417.540342:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788797417.540527:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788797417.540536:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788797417.540542:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788797417.540545:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23ff58f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788797417.540562:0:3615:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e167eef6): req@ffff9a23f90c9880 x1875689390456832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797417.540598:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390464256:0@lo:38:kworker.0 00000100:00100000:3.0:1788797417.540699:0:22852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797417.540729:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a24016b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788797417.540884:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390456832 00000100:00100000:2.0:1788797417.540891:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390456832 00000100:00100000:2.0:1788797417.540925:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797417.540932:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22852:x1875689390456832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788797417.541022:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22852:x1875689390456832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797417.541028:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788797417.541192:0:22852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22852:1875689390456832:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788797417.541226:0:22852:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788797417.541269:0:22852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22852:1875689390464896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788797417.541307:0:22852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797417.541310:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797417.541323:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390465024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797417.541328:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c9b77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797417.541343:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390464896 00000100:00100000:0.0:1788797417.541347:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390464896 00000100:00100000:1.0:1788797417.541359:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797417.546328:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465024 00000100:00100000:0.0:1788797417.546343:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465024 00000100:00100000:0.0:1788797417.546408:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788797417.546419:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22852:x1875689390464896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788797417.546622:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22852:x1875689390464896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 204us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797417.546630:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788797417.546646:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797417.546652:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875689390465024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797417.546673:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797417.546708:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875689390465024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797417.546725:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797417.548542:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390465024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797417.548605:0:22852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22852:1875689390464896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788797417.548752:0:22852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22852:1875689390465152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788797417.549050:0:22852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797417.549083:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c46466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797417.551659:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465152 00000100:00100000:0.0:1788797417.551673:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465152 00000100:00100000:0.0:1788797417.551730:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788797417.551740:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22852:x1875689390465152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788797417.551870:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22852:x1875689390465152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797417.551878:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797417.552989:0:22852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22852:1875689390465152:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788797417.553062:0:22852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797417.563031:0:22852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788797417.563127:0:22852:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1788797417.563133:0:22852:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788797417.784350:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788797417.991547:0:23866:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797417.991757:0:23866:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797418.227003:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788797419.138932:0:23916:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797419.139134:0:23916:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797419.256770:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.280698:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788797420.299124:0:23965:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6c8f5590 20000000:00000080:3.0:1788797420.299141:0:23965:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a23eb5b2400 uarg=0000000000000000 20000000:01000000:3.0:1788797420.299180:0:23965:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788797420.299188:0:23965:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788797420.299192:0:23965:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788797420.300084:0:23966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788797420.300255:0:23965:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788797420.310742:0:23965:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788797420.310777:0:23965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.310903:0:23965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.310912:0:23965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.310929:0:23965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.310978:0:23965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.310993:0:23965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797420.311024:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23965:1875689390465280:0@lo:104: 00000100:00100000:3.0:1788797420.311087:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797420.311149:0:23965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797420.311157:0:23965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797420.311165:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23965:1875689390465408:0@lo:104: 00000100:00100000:3.0:1788797420.311187:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797420.311291:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c2af7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797420.311757:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465280 00000100:00100000:1.0:1788797420.311764:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465280 00000100:00100000:1.0:1788797420.312564:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465408 00000100:00100000:1.0:1788797420.312570:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465408 00000100:00100000:1.0:1788797420.312589:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788797420.312597:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:23965:x1875689390465280:12345-0@lo:104: 00010000:00010000:1.0:1788797420.312612:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312683:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788797420.312689:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:23965:x1875689390465280:12345-0@lo:104: Request processed in 94us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797420.312696:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788797420.312712:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797420.312717:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:23965:x1875689390465408:12345-0@lo:104: 00010000:00010000:1.0:1788797420.312735:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312766:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788797420.312771:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:23965:x1875689390465408:12345-0@lo:104: Request processed in 54us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797420.312776:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788797420.312808:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797420.312814:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312821:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515c00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:1.0:1788797420.312825:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312833:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788797420.312841:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797420.312846:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788797420.312877:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312882:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797420.312904:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797420.312911:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401515c00/0x6418c0ce308ce352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce359 expref: -99 pid: 23543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797420.313193:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390465536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797420.313229:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797420.313269:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465536 00000100:00100000:2.0:1788797420.313273:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465536 00010000:00010000:2.0:1788797420.313291:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 18 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797420.313310:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797420.313317:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3618:x1875689390465536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797420.313327:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797420.313331:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 18 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.313354:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 18 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.313370:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797420.313404:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3618:x1875689390465536:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797420.313411:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788797420.313542:0:23965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084b000/0x6418c0ce308ce359 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce352 expref: 18 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797420.313555:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23965:1875689390465280:0@lo:104: 00000100:00100000:0.0:1788797420.313565:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23965:1875689390465408:0@lo:104: 00010000:00010000:0.0:1788797420.313586:0:23965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797420.313780:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390465536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797420.314065:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797420.314181:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.314183:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.314184:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.314611:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.314613:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797420.314615:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797420.314636:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.314644:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514a00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:0.0:1788797420.314648:0:22798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.314656:0:22798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797420.314662:0:22798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797420.314674:0:22798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797420.314738:0:22798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.314745:0:22798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788797420.314784:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390465664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797420.314840:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788797420.314909:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.314925:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401514a00/0x6418c0ce308ce24f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce256 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.314940:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797420.314942:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797420.314943:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797420.315036:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465664 00000100:00100000:2.0:1788797420.315043:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465664 00010000:00010000:2.0:1788797420.315063:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797420.315094:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797420.315101:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:3619:x1875689390465664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797420.315120:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797420.315126:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315137:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315148:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce24f expref: 17 pid: 22803 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315159:0:22796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315166:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315181:0:22796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315198:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315204:0:22796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315211:0:22796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315217:0:22796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797420.315221:0:22796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315228:0:22796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315239:0:22796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797420.315249:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797420.315458:0:23965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.315467:0:23965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797420.315474:0:23965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401515200/0x6418c0ce308ce3ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797420.319051:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:3619:x1875689390465664:12345-0@lo:103:ldlm_bl.0 Request processed in 3942us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797420.319065:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797420.319954:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390465664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797420.595948:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797405/real 1788797405] req@ffff9a23f90ca680 x1875689390457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797420.595979:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23f90ca680 x1875689390457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797420.595990:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797405/real 1788797405] req@ffff9a23f90c9c00 x1875689390457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797420.596000:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23f90c9c00 x1875689390457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797420.596020:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797420.596043:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797420.596047:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457856:0@lo:8:kworker.0 00000100:00080000:3.0:1788797420.596053:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797420.596058:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797420.596071:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390457984:0@lo:8:kworker.0 00000100:00080000:0.0:1788797420.596227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797420.596231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788797420.596234:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797420.596239:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:0.0:1788797420.596244:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797420.596255:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a23efaab000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797420.596281:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c41b5500 x1875689390465920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797420.596293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797420.596296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797420.596298:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797420.596301:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:0.0:1788797420.596303:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797420.596308:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797420.596320:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c41b6680 x1875689390466048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797420.596364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797420.596368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797420.596371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797420.596374:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797420.596399:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390466176:0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596459:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797420.596489:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797420.596495:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390465792:0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596519:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797420.596544:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390466304:0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797420.596581:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797420.596586:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390466432:0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596607:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797420.596650:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466176 00000100:00100000:0.0:1788797420.596659:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466176 00000100:00100000:0.0:1788797420.596699:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466432 00000100:00100000:0.0:1788797420.596702:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466432 00000100:00100000:0.0:1788797420.596733:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797420.596743:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390466176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596816:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390466176:12345-0@lo:400:kworker.0 Request processed in 74us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797420.596823:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797420.596839:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797420.596845:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.596874:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390466432:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797420.596879:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797420.596957:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390465792 00000100:00100000:0.0:1788797420.596962:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390465792 00000100:00100000:0.0:1788797420.596987:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466304 00000100:00100000:0.0:1788797420.596990:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466304 00000100:00100000:0.0:1788797420.597003:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797420.597010:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390465792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.597039:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390465792:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797420.597045:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797420.597056:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788797420.597062:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.597084:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390466304:12345-0@lo:400:kworker.0 Request processed in 23us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797420.597099:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788797420.597138:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390465792:0@lo:400:kworker.0 00010000:00080000:0.0:1788797420.597148:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c41b7480 x1875689390466176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797420.597158:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390466176:0@lo:400:kworker.0 00010000:00080000:0.0:1788797420.597190:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c41b4380 x1875689390466432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797420.597197:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390466432:0@lo:400:kworker.0 00000100:00100000:0.0:1788797420.597205:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788797420.597282:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390465920:0@lo:8:kworker.0 00000400:00000100:3.0:1788797420.597305:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390465920 offset 0 length 520: 4 00000100:00100000:3.0:1788797420.597329:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c41b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390466048:0@lo:8:kworker.0 00000400:00000100:3.0:1788797420.597355:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390466048 offset 0 length 520: 4 00010000:00010000:1.0:1788797421.303229:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788797422.131191:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788797422.131196:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a22c2ff5000 from 13 10000000:01000000:3.0:1788797422.131201:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797422.131242:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797422.131253:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797422.131264:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797422.131291:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788797422.131365:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797422.131412:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c2af7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797422.131488:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466560 00000100:00100000:0.0:1788797422.131496:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466560 00000100:00100000:0.0:1788797422.131545:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788797422.131556:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+16:22807:x1875689390466560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797422.131569:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797422.131581:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce3b4 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.131603:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 17 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.131612:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 17 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.131620:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e8a00, rc 0) 00000100:00100000:0.0:1788797422.131660:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797422.131679:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788797422.131723:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797422.131738:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.131746:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797422.131824:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797422.131848:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797422.131863:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6ba0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797422.131875:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466688 00000100:00100000:0.0:1788797422.131878:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466688 00000100:00100000:0.0:1788797422.131898:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788797422.132019:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797422.132144:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797422.132927:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797422.132977:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797422.133028:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797422.133052:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3343c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797422.133076:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466816 00000100:00100000:2.0:1788797422.133086:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466816 00000100:00100000:0.0:1788797422.134566:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788797422.134818:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788797422.134829:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797422.135034:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797422.135041:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788797422.151373:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788797422.153112:0:24039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788797422.153230:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788797422.153255:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797422.153266:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797422.153278:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797422.153290:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797422.153292:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a23fc5fe800 from 13 10000000:01000000:2.0:1788797422.153296:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797422.153371:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797422.153380:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797422.153391:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797422.153413:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797422.153477:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797422.153569:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390466944 00000100:00100000:0.0:1788797422.153589:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390466944 00000100:00100000:0.0:1788797422.153633:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788797422.153642:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+17:22807:x1875689390466944:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797422.153654:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3343b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788797422.153656:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797422.153669:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce3c2 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.153691:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 18 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.153701:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 18 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.153709:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9600, rc 0) 00000100:00100000:0.0:1788797422.153749:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390466944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797422.153756:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788797422.153819:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390466944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797422.153832:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797422.153841:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797422.153889:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390467072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797422.153980:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797422.154000:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a240217e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797422.157587:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467072 00000100:00100000:3.0:1788797422.157599:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467072 00000100:00100000:3.0:1788797422.157654:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788797422.157662:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390467072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797422.157826:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390467072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797422.157833:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788797422.157891:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390467072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797422.158667:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390467200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797422.158719:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797422.159386:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c2af7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797422.164023:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467200 00000100:00100000:0.0:1788797422.164050:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467200 00000100:00100000:0.0:1788797422.164183:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788797422.164194:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390467200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797422.164382:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:22807:x1875689390467200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (5662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797422.164390:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788797422.166017:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390467200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797422.171009:0:24040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788797422.171242:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788797422.171270:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797422.171281:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797422.171295:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797422.329162:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797422.648535:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390467328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797422.648608:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797422.648670:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467328 00000100:00100000:3.0:1788797422.648680:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467328 00000100:00100000:3.0:1788797422.648740:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797422.648750:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390467328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797422.648813:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797422.648860:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390467328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797422.648885:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797422.648930:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797412/real 1788797412] req@ffff9a23f90c8000 x1875689390460544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797422 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797422.648951:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23f90c8000 x1875689390460544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797422 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797422.648962:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797412/real 1788797412] req@ffff9a23f90c8700 x1875689390460416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797422 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797422.648973:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23f90c8700 x1875689390460416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797422 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797422.648988:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797422.649007:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797422.649011:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390460544:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788797422.649017:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c3844000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797422.649021:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797422.649024:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390460416:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788797422.649082:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390467328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797422.649460:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390467456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797422.649558:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797422.649595:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467456 00000100:00100000:1.0:1788797422.649599:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467456 00000100:00100000:1.0:1788797422.649624:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797422.649631:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390467456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797422.649650:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797422.649684:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390467456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797422.649690:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797422.649718:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390467456:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788797422.660559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797422.660567:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797422.660570:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797422.660573:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797422.660588:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797422.660591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797422.660595:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a22c3844000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797422.660603:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 672 00000100:00080000:3.0:1788797422.660609:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797422.660622:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a22c3844000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797422.660643:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e6300 x1875689390467840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797422.660659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797422.660661:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797422.660663:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797422.660666:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 672 00000100:00080000:3.0:1788797422.660668:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797422.660680:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797422.660699:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390467840:0@lo:8:kworker.0 00000400:00000100:3.0:1788797422.660746:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390467840 offset 0 length 520: 4 00000100:00100000:3.0:1788797422.660867:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e5500 x1875689390467968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797422.660885:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390467968:0@lo:8:kworker.0 00000100:00100000:1.0:1788797422.660995:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390467584:0@lo:400:kworker.0 00000100:00100000:1.0:1788797422.661043:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797422.661076:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797422.661082:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390467712:0@lo:400:kworker.0 00000100:00100000:1.0:1788797422.661107:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797422.661164:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467584 00000100:00100000:1.0:1788797422.661171:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467584 00000100:00100000:1.0:1788797422.661215:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797422.661224:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3618:x1875689390467584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797422.661270:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3618:x1875689390467584:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797422.661277:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797422.661325:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390467712 00000100:00100000:1.0:1788797422.661328:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390467712 00000100:00100000:1.0:1788797422.661356:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788797422.661362:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390467712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797422.661391:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390467712:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797422.661397:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788797422.661807:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a23d89e7800 x1875689390467712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797422.661821:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390467712:0@lo:400:kworker.0 00000100:00100000:1.0:1788797422.661830:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390467584:0@lo:400:kworker.0 00000400:00000100:3.0:1788797422.662585:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875689390467968 offset 0 length 520: 4 00000100:00100000:3.0:1788797422.662665:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788797422.662701:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797422.668297:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468096 00000100:00100000:0.0:1788797422.668313:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468096 00000100:00100000:0.0:1788797422.668381:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797422.668391:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390468096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797422.668502:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390468096:12345-0@lo:400:kworker.0 Request processed in 113us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797422.668509:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788797422.669226:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a23d89e6d80 x1875689390468096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797422.669242:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390468096:0@lo:400:kworker.0 00000001:00100000:1.0:1788797423.157380:0:23544:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788797423.354305:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797424.372983:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797424.629461:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788797425.398565:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797426.419492:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797427.446480:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788797427.768093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797427.768102:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797427.768106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797427.768110:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797427.768127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797427.768131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797427.768134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797427.768137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797427.768170:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390468608:0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768246:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797427.768333:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788797427.768340:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768371:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797427.768412:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a240169a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390468736:0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768435:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797427.768465:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390468352:0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768486:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797427.768505:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797427.768509:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390468480:0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768545:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797427.768576:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468608 00000100:00100000:3.0:1788797427.768583:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468608 00000100:00100000:3.0:1788797427.768624:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468352 00000100:00100000:3.0:1788797427.768627:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468352 00000100:00100000:3.0:1788797427.768644:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788797427.768652:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390468608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768703:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390468608:12345-0@lo:400:kworker.0 Request processed in 51us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797427.768709:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788797427.768726:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788797427.768732:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390468352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.768763:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390468352:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797427.768770:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788797427.768811:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468224 00000100:00100000:3.0:1788797427.768815:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468224 00000100:00100000:2.0:1788797427.769192:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468736 00000100:00100000:2.0:1788797427.769197:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468736 00000100:00100000:2.0:1788797427.769222:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468480 00000100:00100000:2.0:1788797427.769225:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468480 00000100:00100000:2.0:1788797427.769238:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797427.769244:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390468736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.769291:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390468736:12345-0@lo:400:kworker.0 Request processed in 46us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797427.769297:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797427.769310:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797427.769316:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.769339:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390468480:12345-0@lo:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797427.769345:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797427.769378:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390468864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797427.769402:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788797427.769431:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a23d89e7800 x1875689390468480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797427.769447:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390468480:0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.769457:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390468352:0@lo:400:kworker.0 00010000:00080000:2.0:1788797427.769490:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a240169a300 x1875689390468736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797427.769499:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a240169a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390468736:0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.769536:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390468608:0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.769568:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468864 00000100:00100000:2.0:1788797427.769572:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468864 00000100:00100000:2.0:1788797427.769595:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797427.769601:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390468864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797427.769628:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797427.769665:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390468864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797427.769671:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797427.769699:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390468864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797427.770347:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788797427.770360:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3616:x1875689390468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797427.770407:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:3616:x1875689390468224:12345-0@lo:400:kworker.0 Request processed in 51us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797427.770425:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797427.770506:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390468224:0@lo:400:kworker.0 00000100:00100000:2.0:1788797427.772094:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797427.772110:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390468992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797427.772157:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797427.772193:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390468992 00000100:00100000:2.0:1788797427.772199:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390468992 00000100:00100000:2.0:1788797427.772232:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788797427.772241:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390468992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788797427.772278:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788797427.772321:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390468992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797427.772329:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788797427.772369:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390468992:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1788797427.889102:0:24314:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788797427.889107:0:24314:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788797427.889108:0:24314:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788797427.889528:0:24314:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a23f246d000 00000020:01000004:3.0:1788797427.889546:0:24314:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788797427.889559:0:24314:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788797427.889574:0:24314:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a23efa80000) 00000020:00000080:3.0:1788797427.889593:0:24314:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788797427.942706:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788797427.948416:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788797427.949278:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788797427.949936:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788797427.950315:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788797427.952387:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788797427.953423:0:24314:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788797427.959247:0:24314:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788797427.959449:0:24314:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788797427.959462:0:24314:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788797427.959475:0:24314:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6418c0ce308ce3d7 00000020:01000004:3.0:1788797427.959482:0:24314:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788797427.959505:0:24314:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788797427.959508:0:24314:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788797427.959514:0:24314:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788797427.959518:0:24314:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788797427.959528:0:24314:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a23efa819c0) 00000020:00000080:3.0:1788797427.959535:0:24314:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788797427.965746:0:24314:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797427.965948:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797427.965955:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788797427.969299:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788797427.969312:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788797427.970149:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788797427.970158:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788797427.971503:0:24314:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797427.971686:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788797427.971694:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788797427.974354:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788797427.974363:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788797427.992409:0:24314:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797427.992648:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797427.992653:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788797427.993777:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788797427.993784:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788797427.994651:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788797427.994659:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788797427.996756:0:24314:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797427.997033:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788797427.997038:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788797427.997735:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788797427.997740:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000040:00080000:0.0:1788797428.022536:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797428.096392:0:24314:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797428.096608:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788797428.096618:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788797428.098416:0:24314:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788797428.098425:0:24314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788797428.099735:0:24314:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788797428.099764:0:24314:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788797428.099770:0:24314:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788797428.112032:0:24314:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788797428.112082:0:24314:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.133@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788797428.112087:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788797428.112089:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788797428.112090:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797428.112091:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797428.112092:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797428.112093:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797428.112095:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797428.112096:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797428.112098:0:24314:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797428.112101:0:24314:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788797428.112109:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788797428.112111:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788797428.112112:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797428.112113:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797428.112114:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797428.112115:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797428.112115:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797428.112116:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797428.112117:0:24314:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797428.112143:0:24314:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788797428.112163:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788797428.112307:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.112354:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c31836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.112421:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469120 00000100:00100000:0.0:1788797428.112429:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469120 00000100:00100000:0.0:1788797428.112488:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788797428.112496:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:24314:x1875689390469120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797428.112523:0:22805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788797428.112526:0:22805:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788797428.112529:0:22805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788797428.113077:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:24314:x1875689390469120:12345-0@lo:253:mount.lustre.0 Request processed in 580us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.113096:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788797428.113583:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469120:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797428.113596:0:24314:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788797428.113598:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797428.113599:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788797428.113600:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797428.113601:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797428.113602:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797428.113603:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797428.113604:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797428.113606:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797428.113606:0:24314:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788797428.113764:0:24314:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a23f246d000 from lustre-OST0000 10000000:01000000:3.0:1788797428.114085:0:24314:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788797428.114089:0:24314:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788797428.114097:0:24314:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a23f241b380 local copy 00010000:00010000:3.0:1788797428.114108:0:24314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797428.114289:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797428.114333:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.114410:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c91a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.114466:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469248 00000100:00100000:0.0:1788797428.114472:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469248 00000100:00100000:0.0:1788797428.114543:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797428.114552:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:24314:x1875689390469248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797428.114627:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:24314:x1875689390469248:12345-0@lo:501:mount.lustre.0 Request processed in 76us (293us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788797428.114634:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788797428.114704:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469248:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788797428.114717:0:24314:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788797428.114733:0:24314:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788797428.114738:0:24314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.114747:0:24314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797428.114771:0:24314:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a23f246d000 10000000:01000000:3.0:1788797428.114776:0:24314:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788797428.114811:0:24314:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788797428.114815:0:24314:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797428.114819:0:24314:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788797428.114840:0:24314:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788797428.114868:0:24314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.114876:0:24314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.114885:0:24314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797428.114897:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797428.114921:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.115355:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c91a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.115447:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469376 00000100:00100000:2.0:1788797428.115453:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469376 00000100:00100000:2.0:1788797428.115477:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788797428.115484:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+18:24314:x1875689390469376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797428.115493:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797428.115506:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a240084a800/0x6418c0ce308ce3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce3e5 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.115528:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a240084a800/0x6418c0ce308ce3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce3e5 expref: 19 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.115552:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a240084a800/0x6418c0ce308ce3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce3e5 expref: 19 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.115561:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084a800, rc 0) 00000100:00100000:2.0:1788797428.115600:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469376:12345-0@lo:101:mount.lustre.0 Request processed in 115us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.115605:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797428.115758:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797428.115771:0:24314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3ec expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.115809:0:24314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce3ec expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797428.117611:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788797428.118459:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797428.122425:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788797428.122484:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788797428.122500:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788797428.122514:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788797428.122526:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788797428.122538:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788797428.122551:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788797428.122564:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788797428.122577:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788797428.122589:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788797428.122602:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788797428.122633:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788797428.123436:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788797428.123446:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788797428.123552:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797428.123617:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.123755:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.124067:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469504 00000100:00100000:0.0:1788797428.124076:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469504 00000100:00100000:0.0:1788797428.124126:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797428.124136:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797428.124297:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469504:12345-0@lo:501:mount.lustre.0 Request processed in 163us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.124305:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788797428.124467:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797428.124503:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797428.124556:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.124583:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.124625:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469632 00000100:00100000:0.0:1788797428.124629:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469632 00000100:00100000:0.0:1788797428.124667:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788797428.124674:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797428.125666:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469632:12345-0@lo:503:mount.lustre.0 Request processed in 981us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.125674:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788797428.126088:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797428.126559:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797428.126626:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797428.126739:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.126992:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c91a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.127108:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469760 00000100:00100000:0.0:1788797428.127114:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469760 00000100:00100000:0.0:1788797428.127191:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797428.127200:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797428.127582:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469760:12345-0@lo:502:mount.lustre.0 Request processed in 382us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.127590:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788797428.127677:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797428.128371:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788797428.128405:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788797428.128419:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788797428.128432:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788797428.128445:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788797428.128458:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788797428.128473:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788797428.128487:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788797428.128501:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788797428.128529:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788797428.128543:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788797428.128555:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788797428.128578:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797428.128618:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.133922:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c91a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.135767:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390469888 00000100:00100000:2.0:1788797428.135803:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390469888 00000100:00100000:2.0:1788797428.135884:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788797428.135895:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.136078:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390469888:12345-0@lo:502:mount.lustre.0 Request processed in 185us (7459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.136086:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797428.136835:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390469888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797428.136932:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788797428.136946:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788797428.138162:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788797428.138240:0:24331:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788797428.138247:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.138250:0:24331:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788797428.138257:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797428.138282:0:24331:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a23efa84d40) 00000020:00000080:3.0:1788797428.138308:0:24331:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788797428.138314:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788797428.138397:0:24331:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23f246d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788797428.138405:0:24331:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788797428.138413:0:24331:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6418c0ce308ce3fa 00010000:00010000:3.0:1788797428.149751:0:24331:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788797428.150457:0:24331:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788797428.152292:0:24331:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788797428.153832:0:24331:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788797428.153850:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797428.153857:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153859:0:24331:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788797428.153862:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788797428.153865:0:24331:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788797428.153866:0:24331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797428.153868:0:24331:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797428.153869:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788797428.153872:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153873:0:24331:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788797428.153876:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797428.153879:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153880:0:24331:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788797428.153883:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788797428.153885:0:24331:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788797428.153888:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797428.153890:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153891:0:24331:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788797428.153893:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797428.153896:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153897:0:24331:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788797428.153900:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788797428.153923:0:24331:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797428.153925:0:24331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797428.153927:0:24331:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788797428.153930:0:24331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788797428.154327:0:24314:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788797428.154361:0:24314:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788797428.154384:0:24314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3ec expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.154396:0:24314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2401514400/0x6418c0ce308ce3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce3ec expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797428.154404:0:24314:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a23f246d000 from 1 10000000:01000000:1.0:1788797428.154407:0:24314:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797428.154443:0:24314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.154450:0:24314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.154460:0:24314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797428.154484:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797428.154549:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797428.154585:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c4646f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797428.154870:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470016 00000100:00100000:3.0:1788797428.154878:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470016 00000100:00100000:3.0:1788797428.154924:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788797428.154933:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:24314:x1875689390470016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797428.154946:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797428.154958:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce401 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.154993:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 20 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.155003:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 20 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797428.155011:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514600, rc 0) 00000100:00100000:3.0:1788797428.155282:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470016:12345-0@lo:101:mount.lustre.0 Request processed in 349us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797428.155290:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788797428.156775:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797428.157026:0:24314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.157039:0:24314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797428.159012:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788797428.159617:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797428.159886:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788797428.159911:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788797428.159925:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788797428.159937:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788797428.159948:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788797428.159961:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788797428.159971:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788797428.159982:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788797428.159993:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788797428.160005:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788797428.160031:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788797428.160050:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788797428.160055:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788797428.160134:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797428.160951:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797428.161006:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c4646540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.161134:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470144 00000100:00100000:0.0:1788797428.161142:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470144 00000100:00100000:0.0:1788797428.161205:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797428.161216:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797428.161349:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470144:12345-0@lo:501:mount.lustre.0 Request processed in 135us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.161356:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788797428.161513:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797428.161547:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797428.161589:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.161607:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797428.161658:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470272 00000100:00100000:1.0:1788797428.161671:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470272 00000100:00100000:1.0:1788797428.161699:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788797428.161705:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797428.162407:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470272:12345-0@lo:503:mount.lustre.0 Request processed in 700us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797428.162416:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788797428.162520:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797428.163286:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797428.163376:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.163424:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.163445:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.163467:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470400 00000100:00100000:2.0:1788797428.163472:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470400 00000100:00100000:2.0:1788797428.163515:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788797428.163525:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.163615:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470400:12345-0@lo:502:mount.lustre.0 Request processed in 92us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.163622:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788797428.164163:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797428.164421:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788797428.164447:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788797428.164463:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788797428.164479:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788797428.164508:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788797428.164521:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788797428.164533:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788797428.164545:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788797428.164558:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788797428.164570:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788797428.164582:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788797428.164604:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.164643:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.164761:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470528 00000100:00100000:0.0:1788797428.164767:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470528 00000100:00100000:1.0:1788797428.165018:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788797428.165029:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797428.165125:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470528:12345-0@lo:502:mount.lustre.0 Request processed in 98us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797428.165133:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788797428.166385:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.166410:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797428.166489:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788797428.166504:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788797428.179104:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797428.179119:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.179122:0:24335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788797428.179130:0:24335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a23f246d000 00000020:00000080:1.0:1788797428.179133:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797428.179142:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797428.179144:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.179145:0:24335:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788797428.179147:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797428.179150:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.179151:0:24335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788797428.179154:0:24335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a23f246d000 00000020:00000080:1.0:1788797428.179156:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797428.180465:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797428.180474:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.180476:0:24335:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788797428.180479:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797428.180482:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.180483:0:24335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788797428.180487:0:24335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a23f246d000 00000020:00000080:1.0:1788797428.180489:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797428.190732:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797428.190770:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.190773:0:24335:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788797428.190778:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797428.190783:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.190802:0:24335:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788797428.190809:0:24335:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a23f246d000 00000020:00000080:1.0:1788797428.190811:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788797428.190928:0:24335:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797428.190932:0:24335:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797428.190933:0:24335:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788797428.190937:0:24335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788797428.191414:0:24314:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788797428.191452:0:24314:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797428.191478:0:24314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797428.191491:0:24314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797428.191560:0:24314:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788797428.191563:0:24314:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a23f246d000 10000000:01000000:0.0:1788797428.191567:0:24314:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a23f246d000 10000000:01000000:0.0:1788797428.191571:0:24314:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788797428.191577:0:24314:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a23f246d000 from 1 10000000:01000000:0.0:1788797428.191580:0:24314:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788797428.192238:0:24314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797428.192274:0:24314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797428.192287:0:24314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797428.192373:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797428.192470:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.192528:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788797428.194783:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470656 00000100:00100000:1.0:1788797428.194830:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470656 00000100:00100000:1.0:1788797428.194913:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788797428.194926:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:24314:x1875689390470656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797428.194945:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797428.194964:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2402044a00/0x6418c0ce308ce416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce40f expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.194990:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2402044a00/0x6418c0ce308ce416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce40f expref: 21 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.195003:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2402044a00/0x6418c0ce308ce416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce40f expref: 21 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797428.195012:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2402044a00, rc 0) 00000100:00100000:1.0:1788797428.195087:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390470656:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797428.195093:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797428.195858:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797428.195890:0:24314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce416 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797428.195901:0:24314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce416 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797428.201654:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788797428.203410:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797428.203751:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788797428.203780:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788797428.204400:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788797428.204416:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788797428.204428:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788797428.204442:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788797428.204452:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788797428.204463:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788797428.204494:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788797428.204510:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788797428.204530:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788797428.204543:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788797428.204555:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788797428.204566:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788797428.204577:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788797428.204589:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788797428.204602:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788797428.204615:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788797428.204628:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788797428.204641:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788797428.204654:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788797428.204747:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788797428.204760:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788797428.204773:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788797428.205026:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788797428.205042:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788797428.205056:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788797428.205070:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788797428.205083:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788797428.205095:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788797428.205107:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788797428.205119:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788797428.205132:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788797428.205145:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788797428.205285:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788797428.205368:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788797428.205382:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788797428.205395:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788797428.205410:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788797428.205422:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788797428.205451:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788797428.205466:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788797428.205477:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788797428.205500:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788797428.205512:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788797428.205525:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788797428.205539:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788797428.205550:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788797428.205775:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788797428.206065:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788797428.206085:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788797428.206090:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788797428.206630:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797428.206768:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.207245:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470784 00000100:00100000:2.0:1788797428.207253:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470784 00000100:00100000:0.0:1788797428.207379:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.207526:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788797428.207537:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390470784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797428.207688:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390470784:12345-0@lo:501:mount.lustre.0 Request processed in 154us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.207696:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797428.207769:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797428.207821:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797428.207888:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.208609:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797428.208649:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390470912 00000100:00100000:1.0:1788797428.208656:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390470912 00000100:00100000:1.0:1788797428.208745:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788797428.208753:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390470912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797428.209148:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390470912:12345-0@lo:503:mount.lustre.0 Request processed in 395us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797428.209155:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788797428.209275:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390470912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788797428.209962:0:24314:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788797428.210042:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797428.210093:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.210130:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471040 00000100:00100000:0.0:1788797428.210136:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471040 00000100:00100000:0.0:1788797428.210164:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788797428.210247:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:24314:x1875689390471040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797428.210414:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:24314:x1875689390471040:12345-0@lo:502:mount.lustre.0 Request processed in 170us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.210421:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788797428.210471:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.210486:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797428.210654:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788797428.211033:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788797428.211049:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788797428.211064:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788797428.211078:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788797428.211091:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788797428.211105:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788797428.211119:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788797428.211133:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788797428.211147:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788797428.211161:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788797428.211364:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788797428.211381:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788797428.211400:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788797428.211412:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788797428.211421:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788797428.211431:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788797428.211441:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788797428.211467:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788797428.211481:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788797428.211494:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788797428.211506:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788797428.211518:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788797428.211531:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788797428.211543:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788797428.211555:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788797428.211567:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788797428.211579:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788797428.211591:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788797428.211603:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788797428.211625:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788797428.211637:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788797428.211649:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788797428.211754:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788797428.211783:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788797428.212091:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788797428.212105:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788797428.212119:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788797428.212132:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788797428.212143:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788797428.212156:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788797428.213009:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788797428.213038:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788797428.213050:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788797428.213065:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788797428.213078:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788797428.213090:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788797428.213103:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788797428.213179:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797428.213259:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.213476:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.213585:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471168 00000100:00100000:2.0:1788797428.213593:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471168 00000100:00100000:2.0:1788797428.213651:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788797428.213679:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390471168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.213841:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390471168:12345-0@lo:502:mount.lustre.0 Request processed in 165us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.213856:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788797428.214127:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797428.214439:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788797428.214477:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788797428.214503:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797428.214540:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.214555:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ed4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.214737:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471296 00000100:00100000:2.0:1788797428.214743:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471296 00000100:00100000:2.0:1788797428.214778:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788797428.214808:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390471296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797428.215112:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390471296:12345-0@lo:502:mount.lustre.0 Request processed in 327us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.215119:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788797428.215236:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390471296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797428.215354:0:24314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788797428.215369:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788797428.216184:0:24338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788797428.216199:0:24338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a22c3190000) 00000020:00000080:2.0:1788797428.216222:0:24338:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788797428.216329:0:24338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23f246d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788797428.216333:0:24338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23f246d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788797428.216336:0:24338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23f246d000 3 00010000:00080000:2.0:1788797428.216372:0:24338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23c3629800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797428.223392:0:24338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788797428.223623:0:24338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788797428.226800:0:24338:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797428.226831:0:24338:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6418c0ce308ce424 00000100:00080000:2.0:1788797428.227087:0:24338:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797428.227102:0:24338:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a23c3629800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797428.227139:0:24338:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d9a300 x1875689390471424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797428.227379:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390471424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797428.227448:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788797428.228925:0:24338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788797428.230722:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471424 00000100:00100000:3.0:1788797428.230735:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471424 00000100:00100000:3.0:1788797428.230782:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797428.230807:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875689390471424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788797428.231406:0:22810:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788797428.231444:0:22810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6418c0ce308ce42b 00000004:00100000:3.0:1788797428.231460:0:22810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788797428.231498:0:22810:0:(import.c:65:import_set_state_nolock()) ffff9a23cb174000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797428.234357:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875689390471424:12345-0@lo:38:llog_process_th.0 Request processed in 3538us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797428.234374:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788797428.234478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797428.234484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797428.234496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797428.234498:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797428.234533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797428.234537:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797428.234539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797428.234543:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797428.234578:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390471680:0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.234636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.234664:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797428.234671:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390471552:0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.234697:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.234933:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390471808:0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.234961:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.234980:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797428.234986:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390471936:0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.235007:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.235038:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471680 00000100:00100000:3.0:1788797428.235046:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471680 00000100:00100000:3.0:1788797428.235071:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471936 00000100:00100000:3.0:1788797428.235074:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471936 00000100:00100000:3.0:1788797428.235088:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797428.235095:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390471680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.235141:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390471680:12345-0@lo:400:kworker.0 Request processed in 45us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797428.235156:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797428.235169:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797428.235174:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390471936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797428.235206:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390471936:12345-0@lo:400:kworker.0 Request processed in 31us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797428.235211:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788797428.235245:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a2401699f80 x1875689390471680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797428.235259:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390471680:0@lo:400:kworker.0 00010000:00080000:3.0:1788797428.235296:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a2401698e00 x1875689390471936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797428.235305:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390471936:0@lo:400:kworker.0 00000100:00100000:2.0:1788797428.235588:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471552 00000100:00100000:2.0:1788797428.235593:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471552 00000100:00100000:2.0:1788797428.235619:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390471808 00000100:00100000:2.0:1788797428.235622:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390471808 00000100:00100000:2.0:1788797428.235636:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788797428.235643:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390471552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797428.235683:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390471552:12345-0@lo:400:kworker.0 Request processed in 40us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.235690:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788797428.235702:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797428.235708:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390471808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797428.235738:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390471808:12345-0@lo:400:kworker.0 Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.235744:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:01000004:2.0:1788797428.235866:0:24338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788797428.235880:0:24338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a22c31919c0) 00000020:00000080:2.0:1788797428.235902:0:24338:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788797428.235978:0:24338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a23f246d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788797428.235982:0:24338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a23f246d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788797428.235985:0:24338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a23f246d000 3 00010000:00080000:2.0:1788797428.236012:0:24338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23c362c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797428.237568:0:24338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788797428.237768:0:24338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788797428.237825:0:24338:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797428.237837:0:24338:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6418c0ce308ce439 00000100:00080000:2.0:1788797428.237845:0:24338:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797428.237853:0:24338:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a23c362c800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797428.237882:0:24338:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d98a80 x1875689390472064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797428.237903:0:24338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788797428.237969:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390471552:0@lo:400:kworker.0 00000100:00100000:2.0:1788797428.237999:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390471808:0@lo:400:kworker.0 00000100:00080000:2.0:1788797428.238016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797428.238021:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797428.238024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797428.238027:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797428.238030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797428.238033:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797428.238036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797428.238038:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788797428.239963:0:24338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:0.0:1788797428.240935:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c2d9a300 x1875689390471424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797428.240950:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797428.240962:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788797428.240970:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797428.240975:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788797428.240980:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c3629800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797428.240987:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3615:1875689390471424:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788797428.241004:0:24314:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788797428.241041:0:24314:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788797428.241061:0:24314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce416 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797428.241072:0:24314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c49e8e00/0x6418c0ce308ce40f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce416 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788797428.241124:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788797428.241126:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797428.241128:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797428.241129:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797428.241130:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797428.241132:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797428.241134:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797428.241135:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797428.241137:0:24314:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797428.241140:0:24314:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788797428.241142:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797428.241144:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797428.241145:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797428.241146:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797428.241152:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797428.241154:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797428.241154:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797428.241155:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797428.241156:0:24314:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797428.241743:0:24314:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788797428.241765:0:24314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390472192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797428.241963:0:24314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797428.242014:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472192 00000100:00100000:0.0:1788797428.242021:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472192 00000100:00100000:0.0:1788797428.242068:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788797428.242077:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390472192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797428.242104:0:22804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788797428.242118:0:22804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788797428.243068:0:24314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c90af480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797428.243106:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875689390472064:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797428.243148:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797428.245401:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472064 00000100:00100000:3.0:1788797428.245412:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472064 00000100:00100000:3.0:1788797428.245451:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797428.245459:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390472064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788797428.245487:0:22812:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788797428.245523:0:22812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6418c0ce308ce440 00000004:00100000:3.0:1788797428.259156:0:22812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788797428.259246:0:22812:0:(import.c:65:import_set_state_nolock()) ffff9a23cb173000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797428.259368:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875689390472064:12345-0@lo:38:llog_process_th.0 Request processed in 13894us (16204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797428.259380:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788797428.264096:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a22c2d98a80 x1875689390472064/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797428.264113:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797428.264124:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788797428.264134:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797428.264141:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788797428.264144:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23c362c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797428.264151:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3615:1875689390472064:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788797428.275866:0:22804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788797428.275893:0:22804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788797428.276499:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:24314:x1875689390472192:12345-0@lo:253:mount.lustre.0 Request processed in 34416us (34530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797428.276530:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788797428.276604:0:24314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:24314:1875689390472192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788797428.276618:0:24314:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788797428.276622:0:24314:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788797428.276624:0:24314:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797428.276625:0:24314:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797428.276627:0:24314:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797428.276628:0:24314:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797428.276629:0:24314:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797428.276630:0:24314:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797428.276632:0:24314:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797428.276633:0:24314:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788797428.276650:0:24314:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788797428.283835:0:22826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788797428.283855:0:22826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788797428.283879:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.283899:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.283907:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.283913:0:22826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.283966:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.283989:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 20 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.284004:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390472320:0@lo:104: 00000100:00100000:2.0:1788797428.284074:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797428.284126:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 20 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284135:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 20 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.284142:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390472448:0@lo:104: 00000100:00100000:2.0:1788797428.284166:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.284184:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c5151840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797428.284228:0:22793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788797428.284246:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472320 00000100:00100000:2.0:1788797428.284253:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472320 00000100:00100000:2.0:1788797428.284304:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472448 00000100:00100000:2.0:1788797428.284307:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472448 00000100:00100000:2.0:1788797428.284320:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797428.284328:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390472320:12345-0@lo:104: 00010000:00010000:2.0:1788797428.284339:0:22793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284390:0:22793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797428.284402:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390472320:12345-0@lo:104: Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.284409:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797428.284428:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797428.284435:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fc745c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390472448:12345-0@lo:104: 00010000:00010000:2.0:1788797428.284443:0:22793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284477:0:22793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797428.284482:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fc745c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390472448:12345-0@lo:104: Request processed in 49us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.284488:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788797428.284531:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797428.284538:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284544:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045a00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797428.284547:0:23967:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284556:0:23967:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797428.284564:0:23967:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797428.284570:0:23967:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788797428.284597:0:23967:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284614:0:23967:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797428.284635:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284643:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce39f expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284669:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797428.284674:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284680:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ba00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797428.284683:0:23967:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284690:0:23967:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797428.284696:0:23967:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797428.284701:0:23967:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788797428.284714:0:23967:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284719:0:23967:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797428.284725:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284731:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce38a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce391 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284753:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797428.284754:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797428.284756:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797428.284762:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797428.284774:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390472704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797428.284824:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.284847:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797428.284853:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390472576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797428.284875:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797428.284900:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472704 00000100:00100000:2.0:1788797428.284904:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472704 00010000:00010000:2.0:1788797428.284921:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 21 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.284938:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472576 00000100:00100000:2.0:1788797428.284941:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472576 00010000:00010000:2.0:1788797428.284953:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 22 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.284965:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797428.284972:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:3617:x1875689390472704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797428.284981:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797428.284985:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 22 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.284993:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 22 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285020:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797428.285047:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:3617:x1875689390472704:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.285054:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797428.285068:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797428.285074:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c7502c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3617:x1875689390472576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797428.285082:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797428.285086:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 21 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285095:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 21 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285105:0:22795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285113:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788797428.285126:0:22795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002762759s 00010000:00010000:2.0:1788797428.285131:0:22795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285138:0:22795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285146:0:22795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285164:0:22795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285170:0:22795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084bc00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797428.285174:0:22795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285181:0:22795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285190:0:22795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285199:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797428.285222:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c7502c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3617:x1875689390472576:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797428.285228:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797428.285297:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390472576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797428.285307:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390472704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797428.285331:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2402045800/0x6418c0ce308ce39f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce398 expref: 20 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.285341:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390472320:0@lo:104: 00010000:00010000:2.0:1788797428.285348:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2402044000/0x6418c0ce308ce391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce38a expref: 19 pid: 22804 timeout: 788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797428.285355:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390472448:0@lo:104: 00010000:00010000:2.0:1788797428.285373:0:22826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285381:0:22826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285386:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797428.285393:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084bc00/0x6418c0ce308ce447 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788797428.308054:0:24314:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788797428.321134:0:24314:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788797428.321143:0:24314:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788797428.321194:0:24314:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788797428.321241:0:24314:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788797428.321270:0:24314:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788797428.321349:0:24314:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788797428.325430:0:24314:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797428.325685:0:24314:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788797428.466997:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788797429.428934:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788797429.428942:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a22c2ff5000 from 13 10000000:01000000:0.0:1788797429.428948:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797429.429223:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.429236:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.429248:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797429.429286:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390472832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797429.429354:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797429.430846:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23ec6ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797429.433029:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472832 00000100:00100000:2.0:1788797429.433041:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472832 00000100:00100000:2.0:1788797429.433103:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788797429.433114:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+19:22807:x1875689390472832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797429.433131:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797429.433152:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce44e expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.433274:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 20 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.433286:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 20 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.433295:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084a200, rc 0) 00000100:00100000:2.0:1788797429.433366:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:22807:x1875689390472832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797429.433387:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788797429.433455:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390472832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797429.433473:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.433490:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797429.433557:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390472960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788797429.433596:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797429.433637:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23ec6ce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797429.433670:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390472960 00000100:00100000:1.0:1788797429.433675:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390472960 00000100:00100000:1.0:1788797429.433709:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788797429.433717:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:22807:x1875689390472960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797429.433731:0:22804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797429.433747:0:22804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797429.433750:0:22804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788797429.433879:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:22807:x1875689390472960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797429.433885:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788797429.434110:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390472960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788797429.434229:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788797429.434237:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.434246:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797429.434266:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788797429.434268:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a23fc5fe800 from 13 10000000:01000000:2.0:1788797429.434271:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797429.434290:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.434298:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.434306:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797429.434319:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390473088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797429.434345:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797429.434376:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6eb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797429.434436:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473088 00000100:00100000:0.0:1788797429.434441:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473088 00000100:00100000:0.0:1788797429.434475:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788797429.434482:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:22807:x1875689390473088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797429.434489:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797429.434498:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce45c expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.434514:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 21 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.434523:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 21 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797429.434530:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c49e9a00, rc 0) 00000100:00100000:0.0:1788797429.434569:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390473088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797429.434575:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788797429.435267:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390473088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797429.435282:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.435304:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797429.435343:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390473216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788797429.435375:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797429.435406:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6eb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797429.435446:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473216 00000100:00100000:0.0:1788797429.435452:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473216 00000100:00100000:0.0:1788797429.435480:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788797429.435495:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390473216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788797429.435510:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788797429.435525:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788797429.435528:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788797429.435612:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390473216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797429.435620:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788797429.435680:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390473216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788797429.435728:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788797429.435733:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797429.435742:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797429.499880:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788797429.580234:0:24395:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797429.582147:0:24395:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797430.516961:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797431.539555:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797432.563048:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797432.883166:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797432.883250:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797432.883322:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473344 00000100:00100000:2.0:1788797432.883331:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473344 00000100:00100000:2.0:1788797432.883389:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797432.883399:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390473344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797432.883434:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797432.883477:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390473344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797432.883484:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797432.883555:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390473344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797432.885897:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390473472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797432.885976:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797432.886053:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473472 00000100:00100000:0.0:1788797432.886061:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473472 00000100:00100000:0.0:1788797432.886103:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788797432.886112:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390473472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797432.886142:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797432.886185:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390473472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797432.886192:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788797432.886245:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390473472:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788797433.394943:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797433.394950:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797433.394953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797433.394957:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797433.394999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797433.395003:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797433.395006:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797433.395009:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797433.395059:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.395131:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797433.395182:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875689390474368:0@lo:400:kworker.0 00000100:00100000:0.0:1788797433.395224:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390473728:0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.395225:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797433.395256:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797433.395263:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390473984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797433.395271:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797433.395299:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797433.395310:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390474240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797433.395337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797433.395444:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390473600:0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.395475:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797433.395494:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390474112:0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.395517:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473728 00000100:00100000:2.0:1788797433.395522:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473728 00000100:00100000:2.0:1788797433.395552:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473984 00000100:00100000:2.0:1788797433.395554:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473984 00000100:00100000:2.0:1788797433.395565:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797433.395570:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390473728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.395610:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390473728:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797433.395615:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797433.395627:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788797433.395631:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.395649:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390473984:12345-0@lo:400:kworker.0 Request processed in 19us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797433.395653:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788797433.395665:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473600 00000100:00100000:2.0:1788797433.395667:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473600 00000100:00100000:2.0:1788797433.395683:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788797433.395687:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3616:x1875689390473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.395705:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3616:x1875689390473600:12345-0@lo:400:kworker.0 Request processed in 19us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797433.395709:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788797433.395742:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.400364:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474368 00000100:00100000:2.0:1788797433.400384:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474368 00000100:00100000:1.0:1788797433.400431:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390473856 00000100:00100000:1.0:1788797433.400436:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390473856 00000100:00100000:1.0:1788797433.400470:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474240 00000100:00100000:1.0:1788797433.400472:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474240 00000100:00100000:2.0:1788797433.400482:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797433.400495:0:22811:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788797433.400496:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875689390474368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.400508:0:22811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788797433.400601:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875689390474368:12345-0@lo:400:kworker.0 Request processed in 110us (5388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797433.400609:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797433.400626:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797433.400632:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797433.400635:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.400645:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390474240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.400671:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390473856:12345-0@lo:400:kworker.0 Request processed in 39us (5540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797433.400677:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797433.400693:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390474240:12345-0@lo:400:kworker.0 Request processed in 50us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797433.400699:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788797433.400832:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90cbb80 x1875689390474240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797433.400849:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390474240:0@lo:400:kworker.0 00000100:00100000:2.0:1788797433.400868:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797433.400895:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390473728:0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.400899:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474112 00000100:00100000:1.0:1788797433.400903:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474112 00000100:00100000:2.0:1788797433.400919:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.400928:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797433.400936:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390474112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797433.400976:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390474112:12345-0@lo:400:kworker.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797433.400982:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788797433.401121:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90c8e00 x1875689390474112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797433.401132:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390474112:0@lo:400:kworker.0 00010000:00080000:2.0:1788797433.401159:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90cb800 x1875689390473856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797433.401168:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390473856:0@lo:400:kworker.0 00010000:00080000:2.0:1788797433.401183:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90c8700 x1875689390474368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797433.401190:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875689390474368:0@lo:400:kworker.0 00000100:00080000:3.0:1788797433.403440:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797433.403450:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788797433.588053:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797434.625991:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797434.871634:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797435.639277:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788797436.659175:0:24688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788797436.667691:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797437.492674:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797422/real 1788797422] req@ffff9a23d89e5500 x1875689390467968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797437.492705:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23d89e5500 x1875689390467968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797437.492714:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797422/real 1788797422] req@ffff9a23d89e6300 x1875689390467840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797437.492725:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a23d89e6300 x1875689390467840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797437.492742:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797437.492767:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797437.492771:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390467968:0@lo:8:kworker.0 00000100:00080000:2.0:1788797437.492777:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c3844000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797437.492782:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797437.492806:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390467840:0@lo:8:kworker.0 00000100:00080000:0.0:1788797437.493207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797437.493212:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797437.493215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797437.493218:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797437.493233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797437.493236:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788797437.493238:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c3844000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797437.493243:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1788797437.493249:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797437.493262:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a22c3844000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797437.493280:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c1ce0a80 x1875689390475008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797437.493291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797437.493294:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797437.493296:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797437.493299:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1788797437.493301:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788797437.493305:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797437.493316:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c1ce1c00 x1875689390475136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797437.493377:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390474752:0@lo:400:kworker.0 00000100:00100000:0.0:1788797437.493447:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797437.493497:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390475520:0@lo:400:kworker.0 00000100:00100000:0.0:1788797437.493520:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797437.493538:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788797437.493545:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390474624:0@lo:400:kworker.0 00000100:00100000:0.0:1788797437.493568:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797437.493592:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390475392:0@lo:400:kworker.0 00000100:00100000:0.0:1788797437.493608:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.495000:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390474496:0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495053:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.495085:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390475264:0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495110:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.495135:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797437.495141:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495164:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.495217:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474624 00000100:00100000:2.0:1788797437.495234:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474624 00000100:00100000:2.0:1788797437.495280:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474880 00000100:00100000:2.0:1788797437.495284:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474880 00000100:00100000:2.0:1788797437.495302:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788797437.495311:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390474624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495371:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390474624:12345-0@lo:400:kworker.0 Request processed in 62us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.495378:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788797437.495395:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797437.495401:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390474880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495434:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390474880:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.495439:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797437.495457:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474752 00000100:00100000:2.0:1788797437.495461:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474752 00000100:00100000:2.0:1788797437.495479:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475520 00000100:00100000:2.0:1788797437.495482:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475520 00000100:00100000:2.0:1788797437.495504:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475392 00000100:00100000:2.0:1788797437.495507:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475392 00000100:00100000:2.0:1788797437.495533:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475264 00000100:00100000:2.0:1788797437.495536:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475264 00000100:00100000:2.0:1788797437.495549:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788797437.495554:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495583:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390474752:12345-0@lo:400:kworker.0 Request processed in 28us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.495588:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788797437.495600:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788797437.495607:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390475520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495646:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390475520:12345-0@lo:400:kworker.0 Request processed in 40us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.495878:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788797437.495892:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797437.495899:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390475392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.495996:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390475392:12345-0@lo:400:kworker.0 Request processed in 97us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.496002:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797437.496016:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797437.496022:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390475264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797437.496050:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390475264:12345-0@lo:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.496056:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788797437.496098:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788797437.496102:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788797437.496117:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390475008:0@lo:8:kworker.0 00000100:00100000:2.0:1788797437.496152:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.496190:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390475136:0@lo:8:kworker.0 00000100:00100000:2.0:1788797437.496215:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797437.496250:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475008 00000100:00100000:2.0:1788797437.496255:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475008 00000100:00100000:2.0:1788797437.496272:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475136 00000100:00100000:2.0:1788797437.496274:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475136 00000100:00100000:2.0:1788797437.496282:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797437.496286:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390475008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788797437.496313:0:24320:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 697 last 0 00000020:00000080:2.0:1788797437.496351:0:24320:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce46a 00002000:00100000:2.0:1788797437.496364:0:24320:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a23c362d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788797437.496369:0:24320:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788797437.496372:0:24320:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788797437.496593:0:24320:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788797437.496618:0:24320:0:(import.c:65:import_set_state_nolock()) ffff9a23c362b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797437.496673:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875689390475008:12345-0@lo:8:kworker.0 Request processed in 385us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797437.496680:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797437.496694:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797437.496699:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390475136:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788797437.496710:0:24320:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797437.497302:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390474496 00000100:00100000:0.0:1788797437.497310:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390474496 00000100:00100000:0.0:1788797437.497361:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788797437.497370:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3619:x1875689390474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797437.497414:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3619:x1875689390474496:12345-0@lo:400:kworker.0 Request processed in 47us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797437.497420:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788797437.499917:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390474880:0@lo:400:kworker.0 00000100:00100000:3.0:1788797437.499944:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390474496:0@lo:400:kworker.0 00010000:00080000:3.0:1788797437.499959:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce3b80 x1875689390475264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.499970:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390475264:0@lo:400:kworker.0 00000100:00100000:3.0:1788797437.500015:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390474624:0@lo:400:kworker.0 00010000:00080000:3.0:1788797437.500028:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce0380 x1875689390475392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.500037:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390475392:0@lo:400:kworker.0 00010000:00080000:3.0:1788797437.500049:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce3480 x1875689390474752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.500057:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390474752:0@lo:400:kworker.0 00010000:00080000:3.0:1788797437.500091:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce2300 x1875689390475520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.500099:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390475520:0@lo:400:kworker.0 00010000:00080000:3.0:1788797437.501977:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce0a80 x1875689390475008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.501991:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797437.502002:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788797437.502011:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797437.502017:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788797437.502021:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c3844000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797437.502054:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797437.502061:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390475008:0@lo:8:kworker.0 00000004:00080000:1.0:1788797437.502355:0:23553:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788797437.502380:0:23553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390475776:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788797437.502455:0:23553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797437.502484:0:23553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c3ee2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797437.502505:0:24319:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788797437.502512:0:24319:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788797437.502633:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797437.502644:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390475648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788797437.502918:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797437.503019:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475648 00000100:00100000:1.0:1788797437.503026:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475648 00000100:00100000:1.0:1788797437.503076:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797437.503084:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875689390475648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797437.503111:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797437.503152:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875689390475648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797437.503159:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788797437.503323:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90c8a80 x1875689390475648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797437.503338:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390475648:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788797437.503443:0:23552:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788797437.503546:0:23552:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 697323757023ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788797437.503552:0:23552:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788797437.512079:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475776 00000100:00100000:3.0:1788797437.512095:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475776 00000004:00080000:3.0:1788797437.513085:0:23544:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788797437.513407:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797437.513421:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23553:x1875689390475776:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1788797437.515407:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788797437.524617:0:24712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788797437.524630:0:24712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788797437.540892:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23553:x1875689390475776:12345-0@lo:7:osp-pre-0-1.0 Request processed in 27465us (38426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797437.540914:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788797437.540986:0:23553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90c8700 x1875689390475776/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788797453 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.541000:0:23553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390475776:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788797437.541013:0:23553:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788797437.541052:0:23553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390475904:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788797437.541085:0:23553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797437.541117:0:23553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797437.541141:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390475904 00000100:00100000:3.0:1788797437.541147:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390475904 00000100:00100000:3.0:1788797437.541352:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797437.541362:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23553:x1875689390475904:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788797437.541394:0:24321:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788797437.541437:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23553:x1875689390475904:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797437.541443:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788797437.541469:0:23553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a2401698e00 x1875689390475904/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797453 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.541478:0:23553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390475904:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788797437.541487:0:23553:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788797437.541510:0:23553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390476032:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788797437.541543:0:23553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797437.541556:0:23553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797437.541567:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476032 00000100:00100000:3.0:1788797437.541571:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476032 00000100:00100000:3.0:1788797437.541588:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797437.541594:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23553:x1875689390476032:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788797437.541618:0:24321:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788797437.565418:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390475136:12345-0@lo:8:kworker.0 Request processed in 68705us (69188us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788797437.565434:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797437.571598:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797437.571612:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797437.571618:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390475136:0@lo:8:kworker.0 00000001:00080000:0.0:1788797437.622742:0:24315:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788797437.623278:0:24315:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788797437.626202:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23553:x1875689390476032:12345-0@lo:5:osp-pre-0-1.0 Request processed in 84600us (84650us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788797437.626217:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788797437.626308:0:23553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a2401698e00 x1875689390476032/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797453 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797437.626397:0:23553:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788797437.626406:0:23553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23553:1875689390476032:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788797437.626423:0:23553:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788797437.626541:0:23553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23553:1875689390476160:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788797437.626586:0:23553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797437.626671:0:23553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797437.627106:0:22822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476160 00000100:00100000:3.0:1788797437.627114:0:22822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476160 00000100:00100000:3.0:1788797437.627164:0:22822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797437.627185:0:22822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23553:x1875689390476160:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788797437.627289:0:22822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23553:x1875689390476160:12345-0@lo:900:osp-pre-0-1.0 Request processed in 117us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797437.627297:0:22822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788797437.627401:0:23553:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a2401698e00 x1875689390476160/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797453 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797437.627412:0:23553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401698e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23553:1875689390476160:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788797437.686040:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797438.003165:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390476288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797438.003254:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797438.003347:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476288 00000100:00100000:2.0:1788797438.003357:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476288 00000100:00100000:2.0:1788797438.003425:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797438.003454:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390476288:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797438.003585:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390476416:0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788797438.003603:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797438.003614:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797438.003670:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390476288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 219us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797438.003677:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788797438.003687:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390476288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797438.003692:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476416 00000100:00100000:2.0:1788797438.003695:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476416 00000100:00100000:2.0:1788797438.003718:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788797438.003725:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390476416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788797438.003742:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788797438.003782:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390476416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797438.003813:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788797438.004304:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390476416:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788797438.048163:0:24741:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797438.048556:0:24741:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788797438.267073:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797438.707135:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788797439.441229:0:24791:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797439.449263:0:24791:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788797439.731176:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797440.567339:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797420/real 1788797420] req@ffff9a22c41b5500 x1875689390465920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797440 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797440.567374:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c41b5500 x1875689390465920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797440 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797440.567385:0:3615:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797420/real 1788797420] req@ffff9a22c41b6680 x1875689390466048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797440 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797440.567413:0:3615:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a22c41b6680 x1875689390466048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797440 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797440.567433:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797440.567449:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797440.567462:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390465920:0@lo:8:kworker.0 00000100:00080000:2.0:1788797440.567468:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797440.567473:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797440.567476:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c41b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390466048:0@lo:8:kworker.0 00000100:00080000:2.0:1788797440.567551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797440.567555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788797440.567557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797440.567562:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:2.0:1788797440.567566:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788797440.567587:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a23efaab000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797440.567607:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c2d98380 x1875689390476800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797440.567620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797440.567622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788797440.567624:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797440.567626:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:2.0:1788797440.567629:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788797440.567632:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797440.567640:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e6300 x1875689390476928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797440.567662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797440.567665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788797440.567667:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797440.567670:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1788797440.567677:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788797440.567682:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797440.567691:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23d89e6a00 x1875689390477440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797440.571169:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390477056:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.571259:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797440.571304:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.571327:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797440.571352:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788797440.571359:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390476672:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.571384:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797440.571865:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390476544:0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.571908:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477056 00000100:00100000:2.0:1788797440.571917:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477056 00000100:00100000:2.0:1788797440.571965:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477696 00000100:00100000:2.0:1788797440.571969:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477696 00000100:00100000:2.0:1788797440.572002:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788797440.572012:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390477056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.572067:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390477056:12345-0@lo:400:kworker.0 Request processed in 56us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.572074:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788797440.572091:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797440.572098:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390477696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.572125:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875689390477696:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.572131:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788797440.572336:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797440.572353:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390476800:0@lo:8:kworker.0 00000100:00100000:2.0:1788797440.572386:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797440.572432:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390476928:0@lo:8:kworker.0 00000100:00100000:2.0:1788797440.572456:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797440.572474:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390477440:0@lo:8:kworker.0 00000100:00100000:2.0:1788797440.572509:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797440.572537:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476800 00000100:00100000:2.0:1788797440.572541:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476800 00000100:00100000:2.0:1788797440.572557:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476928 00000100:00100000:2.0:1788797440.572559:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476928 00000100:00100000:2.0:1788797440.572565:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477440 00000100:00100000:2.0:1788797440.572567:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477440 00000100:00100000:3.0:1788797440.572831:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.572856:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788797440.573275:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23d89e5500 x1875689390477056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797440.573292:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390477056:0@lo:400:kworker.0 00010000:00080000:3.0:1788797440.573309:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23d89e7100 x1875689390477696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797440.573317:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1875689390477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.573355:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390477184:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.573383:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797440.573520:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797440.573528:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3615:x1875689390476800:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788797440.573556:0:24319:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 700 last 0 00000100:00100000:1.0:1788797440.573692:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477568 00000100:00100000:1.0:1788797440.573699:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477568 00000100:00100000:1.0:1788797440.573747:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788797440.573755:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a240169a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390477568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797440.573818:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a240169a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390477568:12345-0@lo:400:kworker.0 Request processed in 64us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797440.573834:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788797440.573877:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23d89e5880 x1875689390477568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797440.573888:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.574063:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390477824:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.574089:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797440.574126:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797440.574132:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390476928:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788797440.574155:0:24712:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788797440.574194:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390476928:12345-0@lo:8:kworker.0 Request processed in 60us (1736us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788797440.574211:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797440.574225:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797440.574230:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390477440:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788797440.574241:0:24712:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788797440.574268:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390477440:12345-0@lo:8:kworker.0 Request processed in 37us (1759us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788797440.574274:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797440.574294:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476672 00000100:00100000:3.0:1788797440.574298:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476672 00000100:00100000:3.0:1788797440.574325:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477184 00000100:00100000:3.0:1788797440.574328:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477184 00000100:00100000:3.0:1788797440.574344:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797440.574350:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.574385:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390476672:12345-0@lo:400:kworker.0 Request processed in 35us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797440.574718:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390476672:0@lo:400:kworker.0 00000020:00000080:2.0:1788797440.574962:0:24319:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce471 00002000:00100000:2.0:1788797440.574978:0:24319:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a23c3629000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788797440.574983:0:24319:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788797440.574986:0:24319:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788797440.575065:0:24319:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788797440.575089:0:24319:0:(import.c:65:import_set_state_nolock()) ffff9a23c362f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797440.575129:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875689390476800:12345-0@lo:8:kworker.0 Request processed in 1600us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.575136:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797440.575174:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477824 00000100:00100000:2.0:1788797440.575179:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477824 00000100:00100000:2.0:1788797440.575220:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797440.575227:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.575265:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390477824:12345-0@lo:400:kworker.0 Request processed in 40us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.575272:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797440.575291:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788797440.575300:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390477184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.575341:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390477184:12345-0@lo:400:kworker.0 Request processed in 43us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.575347:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788797440.575377:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390477184:0@lo:400:kworker.0 00000100:00080000:1.0:1788797440.578126:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788797440.578211:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788797440.578291:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c2d98380 x1875689390476800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797440.578304:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797440.578314:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788797440.578323:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797440.578328:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788797440.578331:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23efaab000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797440.578362:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797440.578368:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390476800:0@lo:8:kworker.0 00000100:00080000:3.0:1788797440.578384:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000004:00080000:1.0:1788797440.578603:0:22835:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788797440.578625:0:22835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22835:1875689390478080:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788797440.578687:0:22835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797440.578716:0:22835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2a70a80 going to sleep for 11 seconds 00000004:00080000:1.0:1788797440.579056:0:22834:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788797440.579175:0:22834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 700399386880ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788797440.579183:0:22834:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1788797440.580018:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23d89e6d80 x1875689390477824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797440.580039:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390477824:0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.580069:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797440.580077:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390477952:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797440.580323:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788797440.580328:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390476928:0@lo:8:kworker.0 00000100:00080000:3.0:1788797440.580349:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797440.580352:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788797440.580355:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390477440:0@lo:8:kworker.0 00000100:00100000:3.0:1788797440.580384:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478080 00000100:00100000:2.0:1788797440.580686:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797440.580806:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478080 00000100:00100000:3.0:1788797440.580870:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797440.580880:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22835:x1875689390478080:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788797440.582074:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477952 00000100:00100000:1.0:1788797440.582084:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477952 00000100:00100000:1.0:1788797440.582130:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797440.582140:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390477952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797440.582176:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797440.582250:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390477952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797440.582258:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1788797440.586185:0:22790:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:1.0:1788797440.588094:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797440.594466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797440.594539:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390477312:0@lo:400:kworker.0 00000100:00100000:3.0:1788797440.594573:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797440.594658:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390476544 00000100:00100000:1.0:1788797440.594667:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390476544 00000100:00100000:1.0:1788797440.594725:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788797440.594748:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3617:x1875689390476544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797440.594823:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3617:x1875689390476544:12345-0@lo:400:kworker.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797440.594831:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788797440.594919:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42e4a701-62a9-467c-87db-46cabbbe5ca1:3617:1875689390476544:0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.594921:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390477312 00000100:00100000:2.0:1788797440.594925:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390477312 00000100:00100000:2.0:1788797440.595023:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797440.595030:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390477312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797440.595079:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390477312:12345-0@lo:400:kworker.0 Request processed in 49us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797440.595085:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788797440.595130:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90c8a80 x1875689390477952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797440.595158:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390477952:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788797440.595388:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23d89e4700 x1875689390477312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797440.595398:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390477312:0@lo:400:kworker.0 00000100:00080000:1.0:1788797440.607602:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788797440.614377:0:24712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788797440.614393:0:24712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788797440.614400:0:24712:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:0.0:1788797440.624091:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.624102:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.624657:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.624662:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.624670:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.624690:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.624702:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.624712:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.625283:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.626566:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.626577:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.626590:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e8400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.626596:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.626607:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.626638:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.626646:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce478 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.626666:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.626668:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.626669:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.630019:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.630032:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.630049:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.630054:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.630061:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.630076:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.630087:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.630096:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.630328:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797440.631298:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797440.631309:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.631321:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797440.631326:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.631336:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.631368:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.631375:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce47f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797440.644505:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.644520:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.644538:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.644543:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.644550:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.644565:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.644576:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.644584:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.644619:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.644979:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.644987:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.644996:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.645000:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645009:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645029:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645036:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645059:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.645061:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.645062:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.645393:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.645400:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645410:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.645420:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.645425:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645435:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645443:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645451:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645476:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.645655:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.645660:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645674:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.645678:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645686:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645698:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.645705:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce48d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797440.645779:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.645785:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645826:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.645829:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.645833:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645842:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645850:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645864:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.645878:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.645886:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.646098:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.646104:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.646111:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.646115:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.646130:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.646142:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.646175:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce494 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.647928:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.647937:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.647940:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.655593:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.655601:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.655604:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.661710:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.661718:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.671130:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.671139:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.671143:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.671262:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.671274:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.671292:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.671296:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.671302:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.671320:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.671341:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.671348:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.671368:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.671501:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.671508:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.671515:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.671520:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.671528:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.671553:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.671560:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce49b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.671577:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.671579:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.671581:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.672217:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.672224:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672234:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.672238:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.672242:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672263:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672272:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672280:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672303:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797440.672777:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.672784:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672813:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.672816:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.672821:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672830:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672838:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672857:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.672873:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797440.672939:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797440.672947:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.672955:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.672959:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.672967:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.672981:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.672988:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5741b3f/0x6418c0ce308ce4a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673012:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.673015:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673022:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.673025:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673033:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673043:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673050:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce4a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.673061:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.673063:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.673064:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.673114:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.673693:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.673700:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.673710:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.673713:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.673718:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.673740:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.673749:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.673756:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.673779:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.673926:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.673933:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.673949:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.673952:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.673960:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.673973:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.673980:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce4b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.673996:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.673998:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.673999:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.674276:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.674282:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.674297:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.674300:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.674304:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.674312:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.674321:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.674327:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.674359:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.674851:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.674858:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.674867:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ae00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.674878:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.674887:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.674901:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.674909:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308ce4b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.674924:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.674926:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.674928:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.675019:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.675025:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.675034:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.675037:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.675042:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.675052:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.675072:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.675078:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.675099:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797440.677675:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.677687:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.677702:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.677706:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.677712:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.677724:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.677745:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.677753:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.677805:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797440.677834:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797440.677841:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677849:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.677852:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677861:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677883:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677891:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db41b1a4/0x6418c0ce308ce4be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677907:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.677910:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677916:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.677920:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677927:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677936:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677943:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096770ae0/0x6418c0ce308ce4c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.677954:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.677956:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.677963:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.678414:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797440.679171:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797440.679181:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.679193:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=700s v=(0 0) 00010000:00010000:2.0:1788797440.679196:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797440.679201:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.679211:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.679220:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.679227:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.679247:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.679270:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.679277:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.679285:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084bc00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.679288:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.679296:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.679308:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.679315:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e295c692/0x6418c0ce308ce4cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.679329:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.679331:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.679333:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.686336:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.686351:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.686371:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.686376:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.686382:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.686404:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.686415:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.686421:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.686445:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.686704:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.686711:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.686720:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.686725:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.686734:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.686751:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.686765:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066ea11f4/0x6418c0ce308ce4d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.686783:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.686814:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.686816:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.687042:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.687048:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687057:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.687060:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.687064:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687074:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687082:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687099:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687124:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797440.687207:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.687213:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687221:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515c00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.687231:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687239:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687252:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687257:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7a092d4/0x6418c0ce308ce4da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687271:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.687273:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.687274:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.687698:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.687705:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687715:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.687718:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.687723:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687732:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687740:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687748:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.687769:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797440.687847:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.687852:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687859:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515e00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.687862:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687870:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687883:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687960:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b377ac/0x6418c0ce308ce4e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.687973:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.687974:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.687976:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.688531:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.688537:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688552:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.688555:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.688560:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688569:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688577:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688585:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688606:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797440.688651:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.688657:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.688665:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.688669:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.688677:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.688689:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.688697:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308ce4e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.688711:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.688713:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.688714:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.688959:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.688965:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688973:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.688976:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.688980:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.688992:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689013:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689020:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689041:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.689343:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.689350:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.689358:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.689361:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.689368:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.689381:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.689389:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd41e34b/0x6418c0ce308ce4ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.689404:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.689406:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.689408:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.689497:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.689503:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689511:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.689514:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.689518:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689527:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689535:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689541:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.689571:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797440.689689:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.689695:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.689703:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.689706:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.689714:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.689731:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.689738:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd3b8307/0x6418c0ce308ce4f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.689752:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.689754:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.689755:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.690002:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.690008:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.690017:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.690020:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.690024:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.690032:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.690039:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.690047:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.690065:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797440.690082:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.690087:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.690095:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.690099:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.690118:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.690139:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.690155:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308ce4fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.690169:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.690171:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.690173:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.695205:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.695219:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.695237:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.695247:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.695254:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.695268:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.695280:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.695287:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.695314:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797440.696316:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797440.696327:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.696348:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021dea00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797440.696353:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.696362:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.696382:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.696402:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008074af74/0x6418c0ce308ce504 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.696439:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.696441:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.696443:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.698228:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.698241:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.698258:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.698262:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.698267:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.698279:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.698289:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.698305:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.698327:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.698572:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.698579:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.698588:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.698593:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.698601:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.698616:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.698624:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081a9f0bf/0x6418c0ce308ce50b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.698641:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.698643:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.698645:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797440.698986:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797440.698992:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.699002:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=700s v=(0 0) 00010000:00010000:3.0:1788797440.699005:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797440.699009:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.699018:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.699026:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.699034:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.699059:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797440.699080:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797440.699086:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.699094:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797440.699097:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.699105:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.699131:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.699139:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5bd82bb/0x6418c0ce308ce512 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.699162:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.699164:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.699166:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.704617:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.704633:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.704663:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.704668:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.704675:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.704691:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.704702:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.704710:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.704751:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797440.705327:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.705335:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.705345:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.705348:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.705352:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.705362:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.705382:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.705493:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.705519:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797440.705529:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797440.705536:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705550:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e8600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.705555:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705564:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705581:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705589:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af99d5c9/0x6418c0ce308ce519 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705606:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.705610:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705617:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e8400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.705620:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705628:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705637:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705651:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000917e2fba/0x6418c0ce308ce520 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.705663:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.705665:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.705666:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.705704:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.706102:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.706108:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.706118:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.706121:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.706267:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.706278:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.706286:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.706293:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.706368:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797440.707141:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.707157:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.707168:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.707171:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.707175:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.707185:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.707194:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.707200:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712001:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797440.712017:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712032:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e9800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.712038:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712063:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712085:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712094:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd4c09fb/0x6418c0ce308ce527 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712563:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.712567:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712584:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e9e00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.712587:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712596:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712608:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.712617:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.712618:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.712628:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.713289:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788797440.713298:0:24712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e31bda42/0x6418c0ce308ce52e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.714954:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.715878:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.715889:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.718308:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.718314:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.718322:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.719226:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.719242:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.719250:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.719277:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.720395:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.720404:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.720416:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e8c00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.720420:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.720430:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.720448:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.720455:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f4a2ca/0x6418c0ce308ce535 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.720478:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.720480:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.720482:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.722904:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.722922:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.722940:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.722946:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.722953:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.722965:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.722999:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.723006:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.723027:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797440.723274:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797440.723281:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.723289:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901c00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797440.723294:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.723303:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.723319:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.723327:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcd12259/0x6418c0ce308ce53c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797440.723356:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.723357:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797440.723359:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.726665:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.726678:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.726694:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.726699:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.726704:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.726717:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.726739:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.726748:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.726810:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797440.728230:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797440.728241:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.728253:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797440.728258:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.728268:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.728288:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.728296:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579dcae7/0x6418c0ce308ce543 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797440.728320:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.728322:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797440.728323:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797440.729323:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.729344:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.729357:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.729362:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.729368:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.729380:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.729400:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.729408:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.729473:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797440.730287:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797440.730295:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.730309:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=700s v=(0 0) 00010000:00010000:0.0:1788797440.730319:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797440.730324:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.730344:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.730353:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797440.730360:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736066:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797440.736081:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736096:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.736102:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736114:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736136:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736169:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d8b560c/0x6418c0ce308ce54a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736191:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797440.736195:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736201:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797440.736203:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736211:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736221:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797440.736229:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.736230:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797440.736232:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797440.737302:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788797440.737313:0:24712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b989e1b/0x6418c0ce308ce551 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788797440.737708:0:24712:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788797440.737849:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22835:x1875689390478080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 156967us (159158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797440.737864:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797440.737935:0:22835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22835:1875689390478080:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788797440.737952:0:22835:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788797440.737994:0:22835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22835:1875689390478208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788797440.738029:0:22835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797440.738051:0:22835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c5151000 going to sleep for 11 seconds 00000100:00100000:0.0:1788797440.738076:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478208 00000100:00100000:0.0:1788797440.738083:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478208 00000100:00100000:0.0:1788797440.738393:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797440.738403:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22835:x1875689390478208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788797440.738501:0:24712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1788797440.739036:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788797440.745191:0:24315:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788797440.745240:0:24315:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788797440.746714:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22835:x1875689390478208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8307us (8679us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788797440.746739:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797440.746857:0:22835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788797440.746865:0:22835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22835:1875689390478208:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788797440.746881:0:22835:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1788797440.757292:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797441.781363:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797442.626256:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390478336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797442.626324:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797442.627506:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478336 00000100:00100000:1.0:1788797442.627529:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478336 00000100:00100000:1.0:1788797442.627606:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797442.627618:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390478336:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788797442.627632:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788797442.627649:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797442.627768:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390478336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797442.627777:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797442.627812:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390478336:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788797442.805818:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797443.126713:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390478464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797443.126802:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797443.126858:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478464 00000100:00100000:2.0:1788797443.126878:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478464 00000100:00100000:2.0:1788797443.126924:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797443.126933:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390478464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797443.126977:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797443.127021:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390478464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797443.127028:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797443.127075:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390478464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797443.127558:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390478592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797443.127589:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797443.127663:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478592 00000100:00100000:1.0:1788797443.127668:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478592 00000100:00100000:1.0:1788797443.127762:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788797443.127771:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390478592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797443.127828:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797443.127941:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390478592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797443.127948:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788797443.128053:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390478592:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788797443.834839:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797444.084382:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797444.852013:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788797445.690856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797445.690862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788797445.690865:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797445.690873:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 700 00000100:00080000:2.0:1788797445.690877:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788797445.691152:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797445.691176:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23fa38ed80 x1875689390479232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797445.691219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797445.691223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788797445.691224:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788797445.691228:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 700 00000100:00080000:2.0:1788797445.691230:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788797445.691235:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797445.691245:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23fa38ca80 x1875689390479744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797445.691288:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390478720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797445.691358:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691404:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390479360:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691426:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691444:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390480000:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691486:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788797445.691491:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390479104:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691510:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691525:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390479872:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691542:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691568:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390478848:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691594:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691614:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390479488:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691635:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.691649:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875689390480128:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.691666:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797445.692874:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479360 00000100:00100000:3.0:1788797445.693004:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390479232:0@lo:8:kworker.0 00000100:00100000:3.0:1788797445.693058:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797445.693249:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390479744:0@lo:8:kworker.0 00000100:00100000:3.0:1788797445.693274:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797445.693316:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478720 00000100:00100000:3.0:1788797445.693321:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478720 00000100:00100000:3.0:1788797445.693368:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797445.693377:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390478720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797445.693408:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797445.693453:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390478720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797445.693460:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797445.693481:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480000 00000100:00100000:3.0:1788797445.693485:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480000 00000100:00100000:3.0:1788797445.693506:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479872 00000100:00100000:3.0:1788797445.693508:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479872 00000100:00100000:3.0:1788797445.693517:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480128 00000100:00100000:3.0:1788797445.693519:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480128 00000100:00100000:3.0:1788797445.693533:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797445.693538:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.693569:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390480000:12345-0@lo:400:kworker.0 Request processed in 30us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797445.693576:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797445.693586:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788797445.693591:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390479872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.693613:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390479872:12345-0@lo:400:kworker.0 Request processed in 22us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797445.693619:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788797445.693628:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788797445.693634:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875689390480128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.693666:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875689390480128:12345-0@lo:400:kworker.0 Request processed in 32us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797445.693671:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797445.693754:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479360 00000100:00100000:1.0:1788797445.693779:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797445.693785:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390479360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797445.693852:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390479360:12345-0@lo:400:kworker.0 Request processed in 57us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797445.693858:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797445.693877:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479104 00000100:00100000:1.0:1788797445.693881:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479104 00010000:00080000:2.0:1788797445.694005:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23fa38ce00 x1875689390480128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797445.694020:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1875689390480128:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.694037:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788797445.694046:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390478976:0@lo:400:kworker.0 00000100:00100000:1.0:1788797445.694225:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479232 00000100:00100000:1.0:1788797445.694230:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479232 00000100:00100000:1.0:1788797445.694240:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479744 00000100:00100000:1.0:1788797445.694250:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479744 00000100:00100000:1.0:1788797445.694261:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797445.694268:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390479104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797445.694299:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390479104:12345-0@lo:400:kworker.0 Request processed in 31us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797445.694306:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797445.694317:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788797445.694321:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390479232:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788797445.694339:0:24320:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788797445.694371:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390479232:12345-0@lo:8:kworker.0 Request processed in 48us (1312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788797445.694377:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788797445.694388:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788797445.694392:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390479744:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788797445.694401:0:24320:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788797445.694420:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390479744:12345-0@lo:8:kworker.0 Request processed in 27us (1146us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788797445.694426:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788797445.694463:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788797445.694468:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788797445.694471:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390479232:0@lo:8:kworker.0 00000100:00080000:1.0:1788797445.694494:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788797445.694498:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788797445.694501:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390479744:0@lo:8:kworker.0 00000100:00100000:2.0:1788797445.694711:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.694740:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390479616:0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.694764:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797445.694825:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479616 00000100:00100000:2.0:1788797445.694830:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479616 00000100:00100000:2.0:1788797445.694868:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797445.694875:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390479616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.695397:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390479616:12345-0@lo:400:kworker.0 Request processed in 522us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797445.695405:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797445.695428:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390479488 00000100:00100000:2.0:1788797445.695432:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390479488 00000100:00100000:2.0:1788797445.695453:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478976 00000100:00100000:2.0:1788797445.695456:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478976 00000100:00100000:2.0:1788797445.695468:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788797445.695473:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390479488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.695503:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390479488:12345-0@lo:400:kworker.0 Request processed in 30us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797445.695510:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788797445.695520:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788797445.695525:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797445.695548:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390478976:12345-0@lo:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797445.695553:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788797445.696003:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390478976:0@lo:400:kworker.0 00000100:00100000:0.0:1788797445.696024:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390479616:0@lo:400:kworker.0 00000100:00100000:0.0:1788797445.696036:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390479488:0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.696513:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390478848 00000100:00100000:3.0:1788797445.696520:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390478848 00000100:00100000:0.0:1788797445.698053:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390479104:0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.698200:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788797445.698214:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3618:x1875689390478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797445.698292:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:3618:x1875689390478848:12345-0@lo:400:kworker.0 Request processed in 82us (6696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797445.698299:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788797445.698359:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390478848:0@lo:400:kworker.0 00010000:00080000:0.0:1788797445.698990:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23fa38df80 x1875689390479872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797445.699003:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390479872:0@lo:400:kworker.0 00000100:00100000:0.0:1788797445.699028:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390478720:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788797445.699050:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23fa38e680 x1875689390479360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797445.699059:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390479360:0@lo:400:kworker.0 00010000:00080000:0.0:1788797445.699762:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23fa38d500 x1875689390480000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797445.699775:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390480000:0@lo:400:kworker.0 00000100:00080000:0.0:1788797445.699844:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797445.699850:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797445.699853:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788797445.876338:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797446.900156:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788797447.628038:0:25137:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788797447.628042:0:25137:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788797447.628043:0:25137:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788797447.628176:0:25137:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a22c2ffd000 00000020:01000004:0.0:1788797447.628191:0:25137:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788797447.628206:0:25137:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788797447.628219:0:25137:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a22c20b99c0) 00000020:00000080:0.0:1788797447.628235:0:25137:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788797447.698036:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788797447.701463:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788797447.701726:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797447.702203:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788797447.702491:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788797447.702711:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797447.702907:0:25137:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788797447.703672:0:25137:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788797447.703975:0:25137:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788797447.703989:0:25137:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788797447.704001:0:25137:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6418c0ce308ce55f 00000020:01000004:3.0:1788797447.704007:0:25137:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788797447.704029:0:25137:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.133@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788797447.704032:0:25137:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.133@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788797447.704038:0:25137:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788797447.704067:0:25137:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788797447.704076:0:25137:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.133@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788797447.712517:0:25137:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.133@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797447.712556:0:25137:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.133@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788797447.712561:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797447.712563:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788797447.712564:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797447.712565:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797447.712566:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797447.712568:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797447.712570:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797447.712571:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797447.712573:0:25137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797447.712576:0:25137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788797447.712579:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797447.712580:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788797447.712581:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797447.712582:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797447.712584:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797447.712585:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797447.712586:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797447.712587:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797447.712588:0:25137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797447.712615:0:25137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788797447.712637:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480256:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797447.712780:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797447.712901:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d1f6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.712946:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480256 00000100:00100000:0.0:1788797447.712955:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480256 00000100:00100000:0.0:1788797447.713037:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788797447.713047:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:25137:x1875689390480256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797447.713085:0:22805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788797447.713089:0:22805:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788797447.713093:0:22805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788797447.713768:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:25137:x1875689390480256:12345-0@lo:253:mount.lustre.0 Request processed in 721us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.713777:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788797447.713921:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797447.713934:0:25137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788797447.713936:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797447.713938:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797447.713939:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797447.713940:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797447.713941:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797447.713948:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797447.713949:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797447.713951:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797447.713952:0:25137:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788797447.713971:0:25137:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a22c2ffd000 from lustre-OST0001 10000000:01000000:2.0:1788797447.713996:0:25137:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788797447.714000:0:25137:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788797447.714009:0:25137:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a23f241b380 local copy 00010000:00010000:2.0:1788797447.714018:0:25137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797447.714317:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797447.714513:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.714605:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797447.714647:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480384 00000100:00100000:1.0:1788797447.714653:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480384 00000100:00100000:1.0:1788797447.714822:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788797447.714832:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:25137:x1875689390480384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797447.714903:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:25137:x1875689390480384:12345-0@lo:501:mount.lustre.0 Request processed in 74us (390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788797447.714910:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788797447.714988:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788797447.715002:0:25137:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.133@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788797447.715020:0:25137:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.133@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788797447.715026:0:25137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797447.715036:0:25137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045400/0x6418c0ce308ce192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce199 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797447.715062:0:25137:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a22c2ffd000 10000000:01000000:2.0:1788797447.715067:0:25137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788797447.715072:0:25137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788797447.715074:0:25137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788797447.715088:0:25137:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788797447.715092:0:25137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788797447.715114:0:25137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797447.715132:0:25137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797447.715142:0:25137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797447.715156:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797447.715183:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.715422:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788797447.715508:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480512 00000100:00100000:3.0:1788797447.715513:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480512 00000100:00100000:1.0:1788797447.715547:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788797447.715554:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:25137:x1875689390480512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797447.715563:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797447.715574:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a2402044800/0x6418c0ce308ce56d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce566 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.715594:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a2402044800/0x6418c0ce308ce56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce566 expref: 22 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.715604:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a2402044800/0x6418c0ce308ce56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce566 expref: 22 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.715612:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2402044800, rc 0) 00000100:00100000:1.0:1788797447.715647:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480512:12345-0@lo:101:mount.lustre.0 Request processed in 93us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.715653:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788797447.715720:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797447.715733:0:25137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce56d expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797447.715743:0:25137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce56d expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797447.716840:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788797447.717480:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797447.720020:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788797447.720085:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788797447.720105:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788797447.720120:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788797447.720135:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788797447.720147:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788797447.720160:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788797447.720178:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788797447.720191:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788797447.720216:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788797447.720230:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788797447.720336:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797447.722045:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797447.722290:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480640 00000100:00100000:3.0:1788797447.722299:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480640 00000100:00100000:2.0:1788797447.722312:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797447.722397:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788797447.722407:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797447.722585:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480640:12345-0@lo:501:mount.lustre.0 Request processed in 180us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.722609:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788797447.722688:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797447.722735:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797447.722775:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.722870:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480768 00000100:00100000:0.0:1788797447.722874:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480768 00000100:00100000:0.0:1788797447.722898:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788797447.722906:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797447.723286:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.723612:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480768:12345-0@lo:503:mount.lustre.0 Request processed in 706us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.723619:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788797447.724222:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797447.724891:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797447.726193:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797447.726481:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.726533:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797447.726629:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390480896 00000100:00100000:1.0:1788797447.726638:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390480896 00000100:00100000:1.0:1788797447.726745:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788797447.726755:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797447.729764:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390480896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797447.730240:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788797447.730288:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788797447.730306:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788797447.730318:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788797447.730330:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788797447.730342:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788797447.730355:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788797447.730367:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788797447.730379:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788797447.730418:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797447.730473:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.730630:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390480896:12345-0@lo:502:mount.lustre.0 Request processed in 2898us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.730643:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788797447.730900:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390481152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797447.730931:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797447.730988:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481152 00000100:00100000:3.0:1788797447.730995:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481152 00000100:00100000:3.0:1788797447.731043:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797447.731063:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390481152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788797447.731115:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797447.731154:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390481152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.731160:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797447.731193:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390481152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797447.731220:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2471000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797447.731701:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481024 00000100:00100000:2.0:1788797447.731706:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481024 00000100:00100000:2.0:1788797447.731729:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788797447.731735:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390481024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797447.731884:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390481024:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.731890:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788797447.732110:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797447.732189:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788797447.732200:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00080000:0.0:1788797447.733516:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788797447.734914:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788797447.734925:0:25141:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788797447.734932:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797447.734934:0:25141:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788797447.735008:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797447.735025:0:25141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a22c20b8000) 00000020:00000080:0.0:1788797447.735131:0:25141:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788797447.735140:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788797447.735247:0:25141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a22c2ffd000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788797447.735255:0:25141:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788797447.735262:0:25141:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6418c0ce308ce57b 00010000:00010000:0.0:1788797447.742603:0:25141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788797447.746544:0:25141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1788797447.748739:0:25141:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788797447.773640:0:25141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788797447.773662:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797447.773671:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797447.773673:0:25141:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788797447.773677:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797447.773681:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797447.773683:0:25141:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788797447.773686:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788797447.773688:0:25141:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788797447.773691:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797447.773693:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797447.773694:0:25141:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788797447.773697:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797447.773700:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797447.773701:0:25141:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788797447.773704:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788797447.773736:0:25141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797447.773740:0:25141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797447.773741:0:25141:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788797447.773744:0:25141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788797447.776006:0:25137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788797447.776052:0:25137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788797447.776118:0:25137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce56d expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797447.776141:0:25137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a240084bc00/0x6418c0ce308ce566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce56d expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797447.776223:0:25137:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a22c2ffd000 from 1 10000000:01000000:0.0:1788797447.776227:0:25137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797447.776265:0:25137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.776273:0:25137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.776284:0:25137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797447.776315:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797447.776446:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.776525:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d16e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797447.778051:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481280 00000100:00100000:2.0:1788797447.778064:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481280 00000100:00100000:3.0:1788797447.778240:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788797447.778252:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:25137:x1875689390481280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797447.778267:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797447.778285:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce582 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.778312:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.778323:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.778331:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021df200, rc 0) 00000100:00100000:3.0:1788797447.778411:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481280:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.778418:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788797447.778500:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797447.778517:0:25137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.778527:0:25137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797447.780848:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788797447.781159:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797447.781354:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788797447.781381:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788797447.781395:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788797447.781409:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788797447.781424:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788797447.781448:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788797447.781463:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788797447.781478:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788797447.781493:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788797447.781505:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788797447.781519:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788797447.781536:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788797447.781542:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788797447.781620:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797447.781693:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797447.781739:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797447.786013:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481408 00000100:00100000:3.0:1788797447.786026:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481408 00000100:00100000:3.0:1788797447.786099:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788797447.786109:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797447.786274:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481408:12345-0@lo:501:mount.lustre.0 Request processed in 166us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.786282:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788797447.786305:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797447.786357:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797447.786411:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797447.786492:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797447.786524:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481536 00000100:00100000:3.0:1788797447.786529:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481536 00000100:00100000:3.0:1788797447.786581:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788797447.786595:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797447.786680:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481536:12345-0@lo:503:mount.lustre.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.786687:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788797447.786762:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481536:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797447.787224:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797447.787293:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797447.787334:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.787712:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797447.787810:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481664 00000100:00100000:1.0:1788797447.787816:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481664 00000100:00100000:1.0:1788797447.787846:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788797447.787853:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797447.787946:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481664:12345-0@lo:502:mount.lustre.0 Request processed in 94us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.787954:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788797447.788117:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797447.788346:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788797447.788376:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788797447.788393:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788797447.788407:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788797447.788419:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788797447.788431:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788797447.788444:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788797447.788473:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788797447.788489:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788797447.788503:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788797447.788517:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788797447.788539:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797447.788575:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.788600:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797447.788648:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481792 00000100:00100000:1.0:1788797447.788653:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481792 00000100:00100000:1.0:1788797447.788742:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788797447.788749:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797447.788863:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481792:12345-0@lo:502:mount.lustre.0 Request processed in 115us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.788875:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788797447.788955:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788797447.788999:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788797447.789007:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788797447.791018:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797447.791031:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791033:0:25145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788797447.791040:0:25145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a22c2ffd000 00000020:00000080:3.0:1788797447.791042:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797447.791060:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797447.791063:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791064:0:25145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788797447.791067:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797447.791068:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791070:0:25145:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788797447.791073:0:25145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a22c2ffd000 00000020:00000080:3.0:1788797447.791075:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797447.791181:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797447.791185:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791186:0:25145:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788797447.791190:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797447.791193:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791194:0:25145:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788797447.791199:0:25145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a22c2ffd000 00000020:00000080:3.0:1788797447.791201:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797447.791736:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797447.791741:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791743:0:25145:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788797447.791746:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797447.791749:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.791750:0:25145:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788797447.791754:0:25145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a22c2ffd000 00000020:00000080:3.0:1788797447.791769:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797447.794528:0:25145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797447.794547:0:25145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797447.794550:0:25145:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788797447.794556:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788797447.801612:0:25137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788797447.801659:0:25137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797447.801684:0:25137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.801697:0:25137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797447.801759:0:25137:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788797447.801763:0:25137:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a22c2ffd000 10000000:01000000:1.0:1788797447.801767:0:25137:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a22c2ffd000 10000000:01000000:1.0:1788797447.801772:0:25137:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797447.801778:0:25137:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a22c2ffd000 from 1 10000000:01000000:1.0:1788797447.801780:0:25137:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788797447.801830:0:25137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.801838:0:25137:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.801848:0:25137:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797447.801876:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797447.802007:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797447.802059:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2af2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.802202:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390481920 00000100:00100000:0.0:1788797447.802211:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390481920 00000100:00100000:0.0:1788797447.802265:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788797447.802274:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:25137:x1875689390481920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797447.802287:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797447.802298:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a22c3900a00/0x6418c0ce308ce597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce590 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.802323:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a22c3900a00/0x6418c0ce308ce597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce590 expref: 24 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.802334:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a22c3900a00/0x6418c0ce308ce597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce590 expref: 24 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.802343:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900a00, rc 0) 00000100:00100000:0.0:1788797447.802384:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390481920:12345-0@lo:101:mount.lustre.0 Request processed in 112us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.802390:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788797447.802697:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390481920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797447.802712:0:25137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce597 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.802727:0:25137:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce597 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797447.817376:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788797447.817664:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797447.817843:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788797447.817861:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788797447.817869:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788797447.817876:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788797447.817897:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788797447.817910:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788797447.817917:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788797447.817923:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788797447.817930:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788797447.817936:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788797447.817946:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788797447.817959:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788797447.817971:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788797447.817983:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788797447.817996:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788797447.818009:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788797447.818017:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788797447.818023:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788797447.818030:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788797447.818037:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788797447.818257:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788797447.818333:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788797447.818346:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788797447.818359:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788797447.818370:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788797447.818383:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788797447.818396:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788797447.818408:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788797447.818418:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788797447.818428:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788797447.818439:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788797447.818450:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788797447.818460:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788797447.818471:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788797447.818482:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788797447.818493:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788797447.818520:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788797447.818534:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788797447.818555:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788797447.818567:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788797447.818578:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788797447.818589:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788797447.818601:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788797447.818612:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788797447.818623:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788797447.818633:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788797447.818643:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788797447.818655:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788797447.819341:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788797447.819362:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788797447.819378:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788797447.819384:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788797447.819474:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797447.819537:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.819588:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d16e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797447.828066:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482048 00000100:00100000:2.0:1788797447.828091:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482048 00000100:00100000:2.0:1788797447.828165:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788797447.828186:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797447.828358:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482048:12345-0@lo:501:mount.lustre.0 Request processed in 174us (8819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.828366:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788797447.828375:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797447.828427:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797447.829340:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.829424:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797447.833824:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482176 00000100:00100000:2.0:1788797447.833838:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482176 00000100:00100000:2.0:1788797447.833892:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788797447.833901:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797447.834228:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482176:12345-0@lo:503:mount.lustre.0 Request processed in 328us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.834236:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788797447.835454:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482176:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788797447.843826:0:25137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788797447.843936:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.844015:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.845453:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482304 00000100:00100000:2.0:1788797447.845467:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482304 00000100:00100000:2.0:1788797447.845526:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788797447.845535:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.845897:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.846677:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797447.846970:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788797447.847000:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788797447.847015:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788797447.847028:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788797447.847040:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788797447.847052:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788797447.847064:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788797447.847095:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788797447.847112:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788797447.847125:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788797447.847137:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788797447.847148:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788797447.847159:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788797447.847187:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788797447.847203:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788797447.847216:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788797447.847228:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788797447.847238:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788797447.847248:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788797447.847258:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788797447.847268:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788797447.847279:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788797447.847289:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788797447.847301:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788797447.847313:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788797447.847325:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788797447.847352:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788797447.847368:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788797447.847379:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788797447.847406:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788797447.847421:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788797447.847432:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788797447.847470:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788797447.847484:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788797447.847496:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788797447.847508:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788797447.847519:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788797447.847531:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788797447.847542:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788797447.847554:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788797447.847567:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788797447.847580:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788797447.847590:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788797447.847602:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788797447.847615:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788797447.847643:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788797447.847657:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788797447.847671:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788797447.847718:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.847779:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.847847:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482432 00000100:00100000:0.0:1788797447.847854:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482432 00000100:00100000:0.0:1788797447.847888:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788797447.847895:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:25137:x1875689390482432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.848002:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:25137:x1875689390482432:12345-0@lo:502:mount.lustre.0 Request processed in 106us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.848010:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788797447.848059:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.848091:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797447.848227:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788797447.848246:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788797447.848272:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.848307:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.848330:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482560 00000100:00100000:0.0:1788797447.848333:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482560 00000100:00100000:0.0:1788797447.848348:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788797447.848354:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:25137:x1875689390482560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797447.848410:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:25137:x1875689390482560:12345-0@lo:502:mount.lustre.0 Request processed in 56us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.848417:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788797447.848444:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.848456:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390482560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797447.848489:0:25137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788797447.848496:0:25137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:2.0:1788797447.852015:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390482304:12345-0@lo:502:mount.lustre.0 Request processed in 6473us (7992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.852031:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000020:01000004:1.0:1788797447.852344:0:25151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788797447.852362:0:25151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a23c41b3380) 00000020:00000080:1.0:1788797447.852390:0:25151:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788797447.852491:0:25151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a22c2ffd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788797447.852496:0:25151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a22c2ffd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788797447.852499:0:25151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a22c2ffd000 3 00010000:00080000:1.0:1788797447.852526:0:25151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a23f91db800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:1.0:1788797447.856224:0:25151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788797447.856569:0:25151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788797447.856618:0:25151:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788797447.856631:0:25151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6418c0ce308ce5a5 00000100:00080000:1.0:1788797447.856641:0:25151:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797447.856653:0:25151:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a23f91db800 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:1.0:1788797447.856763:0:25151:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f90cb100 x1875689390482688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797447.856821:0:25151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788797447.856916:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390482688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797447.856994:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788797447.857213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797447.857217:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797447.857220:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797447.857224:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:0.0:1788797447.857227:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788797447.857232:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797447.857243:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c1ce2680 x1875689390483072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797447.857356:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390482816:0@lo:400:kworker.0 00000100:00100000:2.0:1788797447.857398:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.857419:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797447.857425:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788797447.857446:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.857475:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482816 00000100:00100000:2.0:1788797447.857481:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482816 00000100:00100000:2.0:1788797447.857522:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797447.857531:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390482816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797447.857580:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390482816:12345-0@lo:400:kworker.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.857587:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797447.857605:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482944 00000100:00100000:2.0:1788797447.857609:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482944 00000100:00100000:2.0:1788797447.857639:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797447.857645:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797447.857686:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390482944:12345-0@lo:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.857692:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797447.857725:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788797447.857735:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390482816:0@lo:400:kworker.0 00000100:00080000:0.0:1788797447.857894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797447.857898:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797447.857900:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797447.857904:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 705 00000100:00080000:0.0:1788797447.857913:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788797447.857918:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:0.0:1788797447.857931:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c1ce2a00 x1875689390483456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797447.857977:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390483712:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.858006:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.858025:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797447.858029:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390483584:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.858144:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.858171:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390483072:0@lo:8:kworker.0 00000100:00100000:0.0:1788797447.858192:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.858205:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390483456:0@lo:8:kworker.0 00000100:00100000:0.0:1788797447.858221:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788797447.858244:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797447.858253:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390483328:0@lo:400:kworker.0 00000100:00100000:1.0:1788797447.858385:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390482688 00000100:00100000:1.0:1788797447.858391:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390482688 00000100:00100000:1.0:1788797447.858415:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483712 00000100:00100000:1.0:1788797447.858418:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483712 00000100:00100000:1.0:1788797447.858442:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483584 00000100:00100000:1.0:1788797447.858445:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483584 00000100:00100000:1.0:1788797447.858460:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797447.858466:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390483712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797447.858504:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390483712:12345-0@lo:400:kworker.0 Request processed in 39us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.858518:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797447.858532:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797447.858537:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390483584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797447.858563:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390483584:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.858569:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797447.858580:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797447.858583:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3615:x1875689390482688:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788797447.858603:0:22810:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:1.0:1788797447.858632:0:22810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6418c0ce308ce5ac 00000004:00100000:1.0:1788797447.858645:0:22810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788797447.858684:0:22810:0:(import.c:65:import_set_state_nolock()) ffff9a23f91de800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797447.858720:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875689390482688:12345-0@lo:38:llog_process_th.0 Request processed in 135us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.858727:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797447.858746:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483072 00000100:00100000:1.0:1788797447.858749:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483072 00000100:00100000:1.0:1788797447.858764:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483456 00000100:00100000:1.0:1788797447.858766:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483456 00000100:00100000:1.0:1788797447.858776:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797447.858780:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390483072:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788797447.858834:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390483072:12345-0@lo:8:kworker.0 Request processed in 53us (641us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788797447.858840:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797447.858850:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797447.858853:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390483456:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788797447.858889:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3615:x1875689390483456:12345-0@lo:8:kworker.0 Request processed in 34us (667us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788797447.858894:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797447.859029:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.859136:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788797447.859144:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390483200:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859168:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.859187:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390483840:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859207:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.859229:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483200 00000100:00100000:0.0:1788797447.859233:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483200 00000100:00100000:0.0:1788797447.859251:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483840 00000100:00100000:0.0:1788797447.859253:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483840 00000100:00100000:1.0:1788797447.859350:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483328 00000100:00100000:1.0:1788797447.859354:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483328 00000100:00100000:1.0:1788797447.859377:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788797447.859385:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390483328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797447.859423:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390483328:12345-0@lo:400:kworker.0 Request processed in 38us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.859428:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788797447.859551:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797447.859565:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390483200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859594:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390483200:12345-0@lo:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.859599:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797447.859610:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788797447.859616:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390483840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859639:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390483840:12345-0@lo:400:kworker.0 Request processed in 23us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797447.859644:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788797447.859730:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797447.859733:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788797447.859757:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce3480 x1875689390483584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.859769:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390483584:0@lo:400:kworker.0 00010000:00080000:0.0:1788797447.859780:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce0380 x1875689390483712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.859818:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390483712:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859847:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797447.859853:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797447.859856:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788797447.859860:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390483072:0@lo:8:kworker.0 00000100:00100000:0.0:1788797447.859867:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797447.859870:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797447.859873:0:3615:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788797447.859882:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390483456:0@lo:8:kworker.0 00010000:00080000:0.0:1788797447.859901:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a23f90cb100 x1875689390482688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.859908:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797447.859913:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788797447.859919:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797447.859923:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788797447.859925:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f91db800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797447.859929:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3615:1875689390482688:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788797447.859959:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce3b80 x1875689390483200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.859966:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390483200:0@lo:400:kworker.0 00010000:00080000:0.0:1788797447.859973:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c1ce0a80 x1875689390483840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.859979:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390483840:0@lo:400:kworker.0 00000100:00100000:0.0:1788797447.859987:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390483328:0@lo:400:kworker.0 00000020:01000004:2.0:1788797447.860735:0:25151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788797447.860749:0:25151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a22c3194d40) 00000020:00000080:2.0:1788797447.860769:0:25151:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788797447.860872:0:25151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a22c2ffd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788797447.860877:0:25151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a22c2ffd000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788797447.860879:0:25151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a22c2ffd000 3 00010000:00080000:2.0:1788797447.860907:0:25151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a22c40b4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.133@tcp at head 00010000:00010000:2.0:1788797447.868546:0:25151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788797447.868807:0:25151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788797447.868861:0:25151:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797447.868875:0:25151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6418c0ce308ce5ba 00000100:00080000:2.0:1788797447.868885:0:25151:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797447.868898:0:25151:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a22c40b4000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:2.0:1788797447.868935:0:25151:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a22c3a02a00 x1875689390483968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797447.868959:0:25151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788797447.870808:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875689390483968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797447.870886:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797447.871771:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390483968 00000100:00100000:2.0:1788797447.871783:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390483968 00000100:00100000:2.0:1788797447.871854:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797447.871862:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875689390483968:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797447.871893:0:22812:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1788797447.871947:0:22812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6418c0ce308ce5c1 00000004:00100000:2.0:1788797447.871964:0:22812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788797447.872000:0:22812:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797447.872369:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875689390483968:12345-0@lo:38:llog_process_th.0 Request processed in 506us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.872378:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788797447.872571:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a22c3a02a00 x1875689390483968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797447.872583:0:3615:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797447.872593:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788797447.872601:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797447.872614:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788797447.872617:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c40b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797447.872625:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3615:1875689390483968:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788797447.878937:0:25151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788797447.880181:0:25137:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788797447.880220:0:25137:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788797447.880238:0:25137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce597 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797447.880250:0:25137:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a2402045a00/0x6418c0ce308ce590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce597 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788797447.880917:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788797447.880920:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788797447.880921:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797447.880922:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797447.880924:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797447.880926:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797447.880927:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797447.880929:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797447.880930:0:25137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797447.880934:0:25137:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788797447.880937:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797447.880939:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788797447.880940:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797447.880941:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797447.880943:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797447.880944:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797447.880945:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797447.880946:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797447.880947:0:25137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797447.880981:0:25137:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788797447.881004:0:25137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390484096:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797447.881363:0:25137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797447.881417:0:25137:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72840 going to sleep for 11 seconds 00000100:00100000:0.0:1788797447.881452:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484096 00000100:00100000:0.0:1788797447.881459:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484096 00000100:00100000:0.0:1788797447.881506:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788797447.881515:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390484096:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797447.881545:0:22803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788797447.881558:0:22803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788797447.891851:0:22803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788797447.891867:0:22803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788797447.891935:0:22826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788797447.891941:0:22826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788797447.891968:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.891988:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 24 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.891997:0:22826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 24 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892004:0:22826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892043:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 24 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892069:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 24 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797447.892093:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390484224:0@lo:104: 00000100:00100000:2.0:1788797447.892099:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:25137:x1875689390484096:12345-0@lo:253:mount.lustre.0 Request processed in 10584us (10735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797447.892109:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788797447.892131:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797447.892183:0:22826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 23 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892191:0:22826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 23 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797447.892215:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390484352:0@lo:104: 00000100:00100000:3.0:1788797447.892235:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797447.892255:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3343e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797447.892286:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484224 00000100:00100000:3.0:1788797447.892293:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484224 00000100:00100000:3.0:1788797447.892316:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484352 00000100:00100000:3.0:1788797447.892318:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484352 00000100:00100000:3.0:1788797447.892330:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797447.892337:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390484224:12345-0@lo:104: 00010000:00010000:3.0:1788797447.892348:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892387:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788797447.892392:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:22826:x1875689390484224:12345-0@lo:104: Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.892398:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797447.892412:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797447.892418:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390484352:12345-0@lo:104: 00010000:00010000:3.0:1788797447.892424:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892457:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788797447.892462:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:22826:x1875689390484352:12345-0@lo:104: Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797447.892469:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788797447.892484:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797447.892490:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892502:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ba00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797447.892506:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892514:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797447.892520:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797447.892526:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797447.892559:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892565:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797447.892585:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892592:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084ba00/0x6418c0ce308ce45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce463 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892604:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797447.892607:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892612:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c49e9000 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:3.0:1788797447.892615:0:24815:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892630:0:24815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797447.892636:0:24815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797447.892641:0:24815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797447.892652:0:24815:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892657:0:24815:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797447.892683:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892689:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a23c49e9000/0x6418c0ce308ce44e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce455 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.892702:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797447.892704:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797447.892706:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797447.892712:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797447.892724:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390484480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797447.892752:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797447.892864:0:25137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42e4a701-62a9-467c-87db-46cabbbe5ca1:25137:1875689390484096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788797447.892874:0:25137:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788797447.892877:0:25137:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788797447.892878:0:25137:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788797447.892880:0:25137:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797447.892881:0:25137:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797447.892883:0:25137:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797447.892884:0:25137:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797447.892885:0:25137:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788797447.892887:0:25137:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797447.892888:0:25137:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788797447.892900:0:25137:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788797447.893715:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390484608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797447.893749:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797447.893818:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390484224:0@lo:104: 00000100:00100000:3.0:1788797447.893826:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22826:1875689390484352:0@lo:104: 00010000:00010000:3.0:1788797447.893852:0:22826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797447.894545:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484480 00000100:00100000:1.0:1788797447.894554:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484480 00010000:00010000:1.0:1788797447.894581:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 24 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797447.894604:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484608 00000100:00100000:1.0:1788797447.894607:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484608 00010000:00010000:1.0:1788797447.894616:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 25 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797447.894642:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788797447.894649:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:3619:x1875689390484480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797447.894661:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797447.894666:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 25 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894678:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 25 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894694:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9a00/0x6418c0ce308ce463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce45c expref: 25 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894708:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797447.894748:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3619:x1875689390484480:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.894755:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788797447.894769:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797447.894774:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:3616:x1875689390484608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797447.894782:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797447.894806:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 23 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894815:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 23 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894824:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a240084a200/0x6418c0ce308ce455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce44e expref: 23 pid: 22805 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894847:0:22797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894854:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788797447.894867:0:22797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002927231s 00010000:00010000:1.0:1788797447.894871:0:22797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894878:0:22797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894883:0:22797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894890:0:22797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894895:0:22797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797447.894898:0:22797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894905:0:22797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894916:0:22797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797447.894925:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797447.894954:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:3616:x1875689390484608:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797447.894960:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797447.897275:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390484608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797447.897307:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390484480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797447.897309:0:22826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.897320:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797447.897328:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788797447.898465:0:25137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788797447.901238:0:25137:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788797447.901261:0:25137:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788797447.901346:0:25137:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788797447.901404:0:25137:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.133@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788797447.901426:0:25137:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788797447.901452:0:25137:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788797447.905451:0:25137:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797447.905718:0:25137:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797447.924828:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797448.243030:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390484736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797448.243135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797448.243193:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484736 00000100:00100000:2.0:1788797448.243203:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484736 00000100:00100000:2.0:1788797448.243248:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788797448.243257:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390484736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797448.243290:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797448.243332:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390484736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797448.243338:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788797448.243377:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390484736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797448.243826:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797448.243836:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390484864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797448.243864:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797448.243981:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484864 00000100:00100000:0.0:1788797448.243985:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484864 00000100:00100000:0.0:1788797448.244011:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797448.244019:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390484864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797448.244038:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797448.244084:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390484864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797448.244091:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797448.244118:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390484864:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788797448.501059:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797448.965737:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788797449.105216:0:25206:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797449.105532:0:25206:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788797449.846401:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788797449.846408:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a22c2ff5000 from 14 10000000:01000000:0.0:1788797449.846414:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797449.846457:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.846468:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.846488:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797449.846514:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390484992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797449.846579:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797449.846674:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f9397480 going to sleep for 11 seconds 00000100:00100000:3.0:1788797449.860586:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390484992 00000100:00100000:3.0:1788797449.860603:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390484992 00000100:00100000:3.0:1788797449.860672:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788797449.860683:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390484992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797449.861102:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797449.861125:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce5cf expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.861155:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce5cf expref: 23 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.861167:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a24021de800/0x6418c0ce308ce5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce5cf expref: 23 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.861176:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021de800, rc 0) 00000100:00100000:3.0:1788797449.862129:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390484992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1444us (15546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797449.862139:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788797449.862357:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390484992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797449.862375:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5d6 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.862386:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce5d6 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797449.862445:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788797449.862479:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797449.862518:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f9397480 going to sleep for 11 seconds 00000100:00100000:1.0:1788797449.862577:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485120 00000100:00100000:1.0:1788797449.862585:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485120 00000100:00100000:1.0:1788797449.862630:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788797449.862640:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390485120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797449.862657:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797449.862672:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797449.862675:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788797449.862760:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390485120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797449.862768:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788797449.863076:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788797449.863127:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788797449.863134:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5d6 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.863143:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a22c3900000/0x6418c0ce308ce5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5d6 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797449.863152:0:22807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788797449.863155:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a23fc5fe800 from 14 10000000:01000000:3.0:1788797449.863157:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788797449.863176:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.863184:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.863197:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797449.863220:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788797449.863253:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797449.863279:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3b1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797449.863438:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485248 00000100:00100000:0.0:1788797449.863444:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485248 00000100:00100000:0.0:1788797449.863483:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788797449.863492:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390485248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797449.863502:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797449.863514:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a22c3901000/0x6418c0ce308ce5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce5dd expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.863545:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a22c3901000/0x6418c0ce308ce5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce5dd expref: 24 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.863570:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a22c3901000/0x6418c0ce308ce5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce5dd expref: 24 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.863579:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901000, rc 0) 00000100:00100000:0.0:1788797449.863610:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390485248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797449.863616:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788797449.867536:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797449.867566:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5e4 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.867589:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce5e4 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797449.867657:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788797449.867734:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797449.867778:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3b1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797449.867781:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485376 00000100:00100000:0.0:1788797449.867811:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485376 00000100:00100000:3.0:1788797449.867974:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788797449.867991:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390485376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788797449.868011:0:22804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788797449.868027:0:22804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788797449.868030:0:22804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788797449.868915:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390485376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 929us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797449.868926:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788797449.869234:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390485376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788797449.869313:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788797449.869322:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5e4 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797449.869332:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a24021dfa00/0x6418c0ce308ce5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce5e4 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797449.971074:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797450.808001:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390485504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797450.808077:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797450.808197:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485504 00000100:00100000:3.0:1788797450.808205:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485504 00000100:00100000:3.0:1788797450.808272:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797450.808282:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390485504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797450.808309:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797450.808355:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390485504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797450.808361:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797450.808408:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390485504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788797450.808976:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788797450.995103:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797452.019274:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797452.859395:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390485632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797452.859469:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797452.861851:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485632 00000100:00100000:0.0:1788797452.861865:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485632 00000100:00100000:0.0:1788797452.861932:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797452.861943:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390485632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797452.861976:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788797452.862064:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390485632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797452.862075:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788797452.862099:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797452.862148:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390485632:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788797453.047008:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797453.393868:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390485760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797453.393937:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394003:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485760 00000100:00100000:3.0:1788797453.394011:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485760 00000100:00100000:3.0:1788797453.394065:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788797453.394075:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390485760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797453.394112:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797453.394159:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390485760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.394167:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788797453.394214:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390485760:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788797453.394265:0:24458:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797453.394269:0:24458:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797453.394273:0:24458:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797453.394282:0:24458:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a22c4397000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797453.394300:0:24458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f908a680 x1875689390486144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797453.394333:0:24458:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797453.394337:0:24458:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797453.394338:0:24458:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797453.394343:0:24458:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a23f2a64000 using connection 192.168.202.133@tcp/0@lo 00000100:00100000:3.0:1788797453.394353:0:24458:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a23f908b480 x1875689390486656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797453.394395:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394442:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394466:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390486528:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394490:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394508:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875689390487168:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394530:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394548:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788797453.394553:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390486016:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394572:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394591:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390486784:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394625:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394641:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390487296:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.394664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394691:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390486144:0@lo:8:kworker.0 00000100:00100000:3.0:1788797453.394711:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394727:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390486656:0@lo:8:kworker.0 00000100:00100000:3.0:1788797453.394743:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.394770:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390485888 00000100:00100000:3.0:1788797453.394775:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390485888 00000100:00100000:1.0:1788797453.394948:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486528 00000100:00100000:1.0:1788797453.394952:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486528 00000100:00100000:1.0:1788797453.394975:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486016 00000100:00100000:1.0:1788797453.394977:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486016 00000100:00100000:1.0:1788797453.394997:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486144 00000100:00100000:1.0:1788797453.395000:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486144 00000100:00100000:1.0:1788797453.395007:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486656 00000100:00100000:1.0:1788797453.395009:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486656 00000100:00100000:1.0:1788797453.395018:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797453.395037:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390486528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797453.395078:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390486528:12345-0@lo:400:kworker.0 Request processed in 53us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.395084:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788797453.395106:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797453.395112:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390486016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797453.395139:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390486016:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.395145:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797453.395156:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797453.395161:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390486144:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788797453.395185:0:24712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788797453.395212:0:24712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6418c0ce308ce5eb 00002000:00100000:1.0:1788797453.395225:0:24712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a23f91df800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788797453.395229:0:24712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788797453.395232:0:24712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788797453.395399:0:24712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788797453.395420:0:24712:0:(import.c:65:import_set_state_nolock()) ffff9a23f91da800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797453.395457:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875689390486144:12345-0@lo:8:kworker.0 Request processed in 294us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.395463:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797453.395475:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797453.395479:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3615:x1875689390486656:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788797453.395491:0:24712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788797453.395505:0:24712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6418c0ce308ce5f2 00002000:00100000:1.0:1788797453.395510:0:24712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a23f91dc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788797453.395513:0:24712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788797453.395516:0:24712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788797453.395535:0:24712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788797453.395554:0:24712:0:(import.c:65:import_set_state_nolock()) ffff9a23f91d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797453.395579:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3615:x1875689390486656:12345-0@lo:8:kworker.0 Request processed in 98us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.395586:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797453.395784:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788797453.395812:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3618:x1875689390485888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.395859:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3618:x1875689390485888:12345-0@lo:400:kworker.0 Request processed in 48us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.395866:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788797453.395898:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487168 00000100:00100000:3.0:1788797453.395903:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487168 00000100:00100000:3.0:1788797453.395936:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486784 00000100:00100000:3.0:1788797453.395939:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486784 00000100:00100000:3.0:1788797453.395951:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487296 00000100:00100000:3.0:1788797453.395953:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487296 00000100:00100000:3.0:1788797453.395969:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788797453.395975:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875689390487168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396004:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875689390487168:12345-0@lo:400:kworker.0 Request processed in 30us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396010:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788797453.396021:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788797453.396040:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390486784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396066:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390486784:12345-0@lo:400:kworker.0 Request processed in 40us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396072:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788797453.396082:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788797453.396087:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390487296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396110:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390487296:12345-0@lo:400:kworker.0 Request processed in 23us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396115:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788797453.396150:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390486272:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396179:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.396199:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390486912:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396218:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.396235:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788797453.396242:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390486400:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396262:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.396288:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390487040:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396307:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.396329:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486272 00000100:00100000:3.0:1788797453.396333:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486272 00000100:00100000:3.0:1788797453.396352:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486912 00000100:00100000:3.0:1788797453.396355:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486912 00000100:00100000:3.0:1788797453.396367:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487040 00000100:00100000:3.0:1788797453.396369:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487040 00000100:00100000:3.0:1788797453.396383:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797453.396389:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390486272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396420:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875689390486272:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396425:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797453.396436:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797453.396442:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390486912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396464:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390486912:12345-0@lo:400:kworker.0 Request processed in 22us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396469:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797453.396479:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788797453.396485:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390487040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.396507:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390487040:12345-0@lo:400:kworker.0 Request processed in 22us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797453.396512:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788797453.396547:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9088e00 x1875689390487040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.396559:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390487040:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.396579:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9088700 x1875689390486272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.396588:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875689390486272:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.396596:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9088a80 x1875689390486912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.396602:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390486912:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.396633:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f908a680 x1875689390486144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797453.396643:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788797453.396650:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797453.396655:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788797453.396657:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a22c4397000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797453.396668:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797453.396673:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3615:1875689390486144:0@lo:8:kworker.0 00010000:00080000:3.0:1788797453.396684:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f908b480 x1875689390486656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797453.396693:0:3615:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788797453.396697:0:3615:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797453.396700:0:3615:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788797453.396702:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9a23f2a64000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797453.396711:0:3615:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797453.396714:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3615:1875689390486656:0@lo:8:kworker.0 00000004:00080000:3.0:1788797453.396754:0:22837:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788797453.396769:0:22837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22837:1875689390487552:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788797453.396824:0:22837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.396842:0:22837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3b1cf00 going to sleep for 11 seconds 00000004:00080000:3.0:1788797453.396855:0:22836:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788797453.396921:0:22836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 713217132546ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788797453.396928:0:22836:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788797453.396949:0:23554:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788797453.396984:0:23554:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 713217195512ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788797453.396988:0:23554:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788797453.397006:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487552 00000100:00100000:3.0:1788797453.397010:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487552 00000100:00100000:3.0:1788797453.397053:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788797453.397060:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22837:x1875689390487552:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788797453.397430:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390487424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797453.397459:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797453.397504:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390486016:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.397516:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9088380 x1875689390486784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.397525:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390486784:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.397534:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9089f80 x1875689390487296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.397542:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390487296:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.397552:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788797453.397561:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390486528:0@lo:400:kworker.0 00010000:00080000:3.0:1788797453.397572:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f908b800 x1875689390487168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797453.397587:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1875689390487168:0@lo:400:kworker.0 00000004:00080000:2.0:1788797453.398729:0:23555:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788797453.398750:0:23555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390487936:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788797453.398803:0:23555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797453.398825:0:23555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f9397cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797453.398846:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390486400 00000100:00100000:2.0:1788797453.398852:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390486400 00000100:00100000:2.0:1788797453.398888:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788797453.398897:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390486400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797453.398955:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390486400:12345-0@lo:400:kworker.0 Request processed in 60us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797453.398962:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788797453.398986:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788797453.398991:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788797453.398994:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788797453.398996:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797453.399107:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487424 00000100:00100000:0.0:1788797453.399112:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487424 00000100:00100000:0.0:1788797453.399140:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797453.399148:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390487424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797453.399168:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788797453.399205:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390487424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797453.399211:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797453.399543:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487936 00000100:00100000:3.0:1788797453.399548:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487936 00000100:00100000:3.0:1788797453.399582:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797453.399589:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23555:x1875689390487936:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788797453.403930:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797453.403956:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390487808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797453.404038:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797453.404087:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487808 00000100:00100000:0.0:1788797453.404095:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487808 00000100:00100000:0.0:1788797453.404139:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797453.404148:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875689390487808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788797453.404187:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788797453.404228:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3619:x1875689390487808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797453.404235:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788797453.404276:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c3a01f80 x1875689390487808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797453.404295:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390487808:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788797453.404345:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c39ddc00 x1875689390487424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797453.404357:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390487424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797453.404370:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390486400:0@lo:400:kworker.0 00000100:00100000:0.0:1788797453.404382:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797453.404388:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390487680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797453.404413:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797453.404441:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390487680 00000100:00100000:0.0:1788797453.404444:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390487680 00000100:00100000:0.0:1788797453.404470:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788797453.404476:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390487680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797453.404499:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797453.404530:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390487680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797453.404536:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788797453.404562:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390487680:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1788797453.405112:0:23544:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00080000:3.0:1788797453.405205:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788797453.405950:0:22790:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788797453.409321:0:24712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788797453.409332:0:24712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788797453.409338:0:24712:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1788797453.410711:0:24319:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788797453.410719:0:24319:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788797453.410826:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23555:x1875689390487936:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11235us (12019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.410837:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788797453.410938:0:23555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c3a01c00 x1875689390487936/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788797469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797453.410952:0:23555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390487936:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788797453.410966:0:23555:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788797453.411003:0:23555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390488064:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788797453.411051:0:23555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797453.411083:0:23555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c4361780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797453.411149:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488064 00000100:00100000:1.0:1788797453.411155:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488064 00000100:00100000:1.0:1788797453.411235:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788797453.411243:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23555:x1875689390488064:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788797453.411266:0:24320:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788797453.411299:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23555:x1875689390488064:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.411305:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788797453.416769:0:23555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c1ce3480 x1875689390488064/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797469 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797453.416901:0:23555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390488064:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788797453.416919:0:23555:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788797453.416972:0:23555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390488192:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788797453.417097:0:23555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797453.417166:0:23555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c90af0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797453.422718:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488192 00000100:00100000:3.0:1788797453.422733:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488192 00000100:00100000:3.0:1788797453.422818:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797453.422829:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23555:x1875689390488192:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788797453.422873:0:24321:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1788797453.427601:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.427622:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.427637:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.427642:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.427647:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.427663:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.427673:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.427681:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.427705:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797453.428110:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.428116:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428125:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.428127:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.428131:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428139:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428147:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428155:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428168:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788797453.428443:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.428449:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428457:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.428464:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.428468:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428479:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428486:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428493:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428509:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788797453.428777:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.428782:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428808:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.428811:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.428815:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428824:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428832:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428845:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428859:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788797453.428869:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788797453.428874:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428882:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.428887:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428896:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428912:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428920:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000588bcb8b/0x6418c0ce308ce5f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428935:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788797453.428939:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428955:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ba00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.428959:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428967:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428977:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428985:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d90712b/0x6418c0ce308ce600 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.428996:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797453.428999:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429005:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.429008:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429015:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429054:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429067:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096770ae0/0x6418c0ce308ce607 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429080:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797453.429083:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429090:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.429093:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429100:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429110:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429117:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db41b1a4/0x6418c0ce308ce60e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429127:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.429129:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.429130:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.429405:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.429411:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429425:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.429428:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.429432:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429441:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429448:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429455:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.429474:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797453.431948:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797453.431961:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.431974:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.431979:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.431989:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.432013:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.432021:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcbf4e66/0x6418c0ce308ce615 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.432059:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.432061:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.432063:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.434475:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.434590:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.434599:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434664:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.434668:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.434672:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434823:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434846:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434851:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434863:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797453.434871:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797453.434875:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434879:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ae00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.434882:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434888:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434898:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434902:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2382d5/0x6418c0ce308ce61c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.434913:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.434918:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.434919:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.435148:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.435153:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.444149:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.444186:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.444214:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.444220:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.444228:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.444244:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.444256:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.444264:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.444291:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797453.448868:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.448884:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.448915:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.448920:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.448932:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.448958:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.448967:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce623 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.449071:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.449073:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.449075:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797453.449943:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797453.449954:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.449967:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1788797453.449972:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797453.449977:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.449995:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.450015:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.450034:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.450070:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797453.462521:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.462544:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.462563:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021dee00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.462568:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.462579:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.462625:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.462632:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af2b2161/0x6418c0ce308ce62a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.462657:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.462659:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.462660:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.462988:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.462994:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.463005:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.463009:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.463015:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.463147:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.463157:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.463164:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.463203:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797453.463602:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797453.463615:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.463623:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402044000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.463626:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.463634:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.463645:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.463652:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce631 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.463668:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.463675:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.463677:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.466128:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.466141:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466157:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.466161:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.466178:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466193:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466203:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466211:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466234:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788797453.466740:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.466747:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466756:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.466765:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.466770:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466908:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466916:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466924:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466937:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797453.466946:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797453.466951:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466958:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.466962:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466970:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.466984:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467001:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce638 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467020:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.467035:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467041:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.467044:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467051:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467061:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467068:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce63f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.467081:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.467083:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.467084:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.467263:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.469371:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.469385:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469410:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.469414:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.469419:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469432:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469441:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469449:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469469:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797453.469481:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.469486:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469494:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.469498:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469506:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.469531:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.470070:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce646 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.470088:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.470090:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.470092:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.474530:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.474543:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.474558:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.474562:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.474567:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475171:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475184:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475193:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475221:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797453.475326:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.475334:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.475345:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.475350:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.475359:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.475374:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.475381:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5741b3f/0x6418c0ce308ce64d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.475410:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.475412:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.475414:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.475691:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.475696:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475703:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.475705:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.475708:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475714:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475719:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475732:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.475746:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797453.476013:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.476019:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.476037:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.476040:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.476044:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.476051:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.476058:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.476065:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.476087:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797453.476213:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797453.476220:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476228:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.476232:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476239:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476250:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476256:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e07a3e/0x6418c0ce308ce654 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476270:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.476273:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476279:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c0031a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.476288:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476295:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476304:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476310:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe1e5093/0x6418c0ce308ce65b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.476321:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.476323:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.476324:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.476829:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.477851:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.477860:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.477873:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.477877:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.477882:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.477894:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.477903:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.477917:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.477935:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797453.477947:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797453.477959:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.477966:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.477969:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.477977:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.477994:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.478003:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce662 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.478022:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.478032:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.478034:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.478978:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.478986:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.478997:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.479000:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.479004:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.479037:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.479047:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.479054:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.479072:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797453.481124:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797453.481136:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.481148:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c0031200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.481152:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.481178:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.481195:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.481200:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e9540f/0x6418c0ce308ce669 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.481226:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.481227:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.481228:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797453.481366:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797453.481375:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.481386:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=713s v=(0 0) 00010000:00010000:2.0:1788797453.481390:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797453.481395:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.481406:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.481415:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.481434:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.481847:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788797453.483092:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.483103:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.483117:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.483121:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.483126:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.483138:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.483147:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.483155:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797453.484438:0:25138:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788797453.484469:0:25138:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788797453.484472:0:25138:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788797453.484557:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797453.484565:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484575:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c0030000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.484580:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484590:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484770:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484814:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000463c4c93/0x6418c0ce308ce670 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484834:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797453.484837:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484844:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.484847:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484854:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484863:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.484871:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.484873:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.484875:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.485100:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.485121:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788797453.485131:0:24712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd3b8307/0x6418c0ce308ce677 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797453.485312:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23555:x1875689390488192:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62482us (68210us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788797453.485323:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788797453.485341:0:23555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788797453.485351:0:23555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23555:1875689390488192:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788797453.485368:0:23555:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788797453.485417:0:23555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23555:1875689390488320:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788797453.485460:0:23555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797453.485520:0:23555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c4361240 going to sleep for 11 seconds 00002000:00010000:1.0:1788797453.485777:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.485783:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.485808:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.485812:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.485816:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.485825:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.485831:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.485835:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.485848:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797453.485902:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797453.485909:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.485917:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.485920:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.485928:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.485939:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.485946:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd41e34b/0x6418c0ce308ce67e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.485958:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.485960:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.485962:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797453.486140:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797453.486146:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486154:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:0.0:1788797453.486162:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797453.486177:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486186:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486194:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486200:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486215:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797453.486233:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.486239:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486260:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901600 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.486263:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486271:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486339:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486348:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000579dcae7/0x6418c0ce308ce685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486360:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.486361:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.486362:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.486544:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.486549:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486554:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.486557:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.486559:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486566:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486579:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486583:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.486591:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797453.486615:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797453.486622:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486630:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514a00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:0.0:1788797453.486633:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486642:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486653:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486672:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008367939c/0x6418c0ce308ce68c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797453.486686:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.486688:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797453.486689:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.487934:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.487944:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.487953:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.487956:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.487959:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.487966:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.487972:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.487977:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488000:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788797453.488362:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.488368:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488375:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.488379:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.488383:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488392:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488399:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488406:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488423:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797453.488432:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797453.488436:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488443:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515e00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.488455:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488463:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488477:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488484:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002b377ac/0x6418c0ce308ce693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488500:0:23967:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797453.488503:0:23967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488509:0:23967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515c00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797453.488513:0:23967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488520:0:23967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488530:0:23967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488537:0:23967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7a092d4/0x6418c0ce308ce69a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488554:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.488555:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.488557:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797453.488746:0:22822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488320 00000100:00100000:2.0:1788797453.488755:0:22822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488320 00002000:00010000:1.0:1788797453.488756:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.488761:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488767:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.488769:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.488771:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488777:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488782:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488806:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.488816:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797453.488841:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797453.488850:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.488860:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.488864:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.488871:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.488900:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.488905:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ea11f4/0x6418c0ce308ce6a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.488916:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.488917:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.488918:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.489170:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.489175:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489194:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.489197:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.489201:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489211:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489219:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489226:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797453.489235:0:22822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797453.489246:0:22822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23555:x1875689390488320:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788797453.489247:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788797453.489344:0:22822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23555:x1875689390488320:12345-0@lo:900:osp-pre-1-1.0 Request processed in 99us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797453.489350:0:22822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788797453.489370:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797453.489375:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.489383:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.489387:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.489394:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.489416:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.489423:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bdae475/0x6418c0ce308ce6a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.489435:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.489437:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.489439:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788797453.489466:0:23555:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c1ce0a80 x1875689390488320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797469 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797453.489479:0:23555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c1ce0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23555:1875689390488320:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788797453.489645:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797453.489683:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797453.489687:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489694:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.489696:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.489699:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489705:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489718:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489723:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489735:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788797453.489960:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.489964:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489970:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.489971:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.489974:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489979:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489984:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.489989:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490008:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797453.490043:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797453.490049:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490057:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402044000 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.490065:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490073:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490085:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490092:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a33108/0x6418c0ce308ce6af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490105:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797453.490108:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490114:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.490118:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490125:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490133:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490139:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064622f9b/0x6418c0ce308ce6b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490155:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.490156:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.490158:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.490342:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.490346:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490352:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.490354:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.490356:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490362:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490368:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490372:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490380:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797453.490386:0:22798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797453.490391:0:22798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490400:0:22798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045800 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.490403:0:22798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490412:0:22798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490422:0:22798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490429:0:22798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038f6643/0x6418c0ce308ce6bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.490444:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.490446:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.490448:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.490495:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.490669:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.490718:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490723:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.490729:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.490732:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490739:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490744:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490748:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.490764:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797453.490857:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797453.490863:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.490870:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5c00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797453.490873:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.490881:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.490890:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.490903:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ad536fe/0x6418c0ce308ce6c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797453.490917:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.490919:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797453.490920:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797453.491071:0:24712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797453.491076:0:24712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.491081:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788797453.491084:0:24712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797453.491088:0:24712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.491096:0:24712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.491104:0:24712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.491118:0:24712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797453.491129:0:24712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788797453.491154:0:24712:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788797453.491222:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22837:x1875689390487552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94161us (94395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797453.491230:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788797453.491244:0:24815:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797453.491250:0:24815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.491267:0:24815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4400 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797453.491271:0:24815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797453.491277:0:22837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22837:1875689390487552:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788797453.491280:0:24815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788797453.491293:0:22837:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00010000:00010000:3.0:1788797453.491294:0:24815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.491306:0:24815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c780513d/0x6418c0ce308ce6cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797453.491321:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.491322:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797453.491324:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797453.491334:0:22837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22837:1875689390488448:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788797453.491361:0:22837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797453.491385:0:22837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c3183840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797453.491396:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488448 00000100:00100000:3.0:1788797453.491403:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488448 00000100:00100000:3.0:1788797453.491439:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797453.491447:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22837:x1875689390488448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788797453.491477:0:24320:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1788797453.494919:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22837:x1875689390488448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3467us (3550us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788797453.494931:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788797453.494939:0:22837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f90cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22837:1875689390488448:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788797453.494953:0:22837:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788797454.066937:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797454.337743:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788797454.716757:0:25495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg233-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788797455.090942:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788797455.768824:0:25548:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797455.769065:0:25548:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788797455.924198:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797455.924224:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390488576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797455.924301:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797455.924561:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488576 00000100:00100000:2.0:1788797455.924571:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488576 00000100:00080000:3.0:1788797455.924616:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797455.924628:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797455.924638:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390488576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797455.924666:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788797455.924713:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390488576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797455.924721:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797455.924755:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390488576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788797456.115052:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788797456.831474:0:25598:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797456.831697:0:25598:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788797456.995601:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797457.003848:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376728960 00000100:00100000:0.0:1788797457.003864:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376728960 00000100:00100000:0.0:1788797457.003914:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:0.0:1788797457.003923:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875689376728960:12345-192.168.202.33@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788797457.003952:0:22804:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4a512648-c64e-4a48-9f3b-a8a92c7adc91@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:0.0:1788797457.003982:0:22804:0:(genops.c:1384:class_connect()) connect: client 4a512648-c64e-4a48-9f3b-a8a92c7adc91, cookie 0x6418c0ce308ce6d2 00000100:00080000:0.0:1788797457.004122:0:22804:0:(import.c:65:import_set_state_nolock()) ffff9a23ec648800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797457.004196:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+5:2403:x1875689376728960:12345-192.168.202.33@tcp:250:mount.lustre.0 Request processed in 272us (8607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797457.004203:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 117 00000100:00100000:1.0:1788797457.009768:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.010072:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729088 00000100:00100000:2.0:1788797457.010082:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729088 00000100:00100000:2.0:1788797457.010133:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:2.0:1788797457.010142:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+5:18081:x1875689376729088:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797457.010158:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797457.010176:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c0031a00/0x6418c0ce308ce6d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca810f expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.010727:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c0031a00/0x6418c0ce308ce6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca810f expref: 6 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.010738:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c0031a00/0x6418c0ce308ce6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca810f expref: 6 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.010746:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c0031a00, rc 0) 00000100:00100000:2.0:1788797457.010820:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+6:18081:x1875689376729088:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 678us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.010828:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 118 00000100:00100000:1.0:1788797457.014631:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.014703:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729216 00000100:00100000:3.0:1788797457.014713:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729216 00000100:00100000:3.0:1788797457.014778:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:3.0:1788797457.014806:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+6:18081:x1875689376729216:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788797457.014925:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+6:18081:x1875689376729216:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 138us (303us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788797457.014932:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 119 00000100:00100000:2.0:1788797457.019046:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.019110:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729344 00000100:00100000:3.0:1788797457.019121:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729344 00000100:00100000:3.0:1788797457.019171:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:3.0:1788797457.019190:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+6:18081:x1875689376729344:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788797457.019206:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797457.019223:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a24021de000/0x6418c0ce308ce6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8116 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797457.019251:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021de000/0x6418c0ce308ce6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8116 expref: 7 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797457.019263:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a24021de000/0x6418c0ce308ce6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8116 expref: 7 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797457.019273:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021de000, rc 0) 00000100:00100000:3.0:1788797457.019343:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+7:18081:x1875689376729344:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797457.019351:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 120 00000100:00100000:1.0:1788797457.021631:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.021699:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729472 00000100:00100000:3.0:1788797457.021706:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729472 00000100:00100000:3.0:1788797457.021754:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:3.0:1788797457.021763:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+7:18081:x1875689376729472:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788797457.021924:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18081:x1875689376729472:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 162us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797457.021931:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 121 00000100:00100000:2.0:1788797457.028258:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.028364:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729600 00000100:00100000:1.0:1788797457.028374:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729600 00000100:00100000:1.0:1788797457.028436:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:1.0:1788797457.028461:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18081:x1875689376729600:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788797457.028638:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18081:x1875689376729600:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 178us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.028646:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 122 00000100:00100000:0.0:1788797457.032209:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.034150:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729728 00000100:00100000:2.0:1788797457.034165:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729728 00000100:00100000:2.0:1788797457.034230:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:2.0:1788797457.034241:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729728:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797457.034402:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729728:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 163us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.034410:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 123 00000100:00100000:0.0:1788797457.065912:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.066065:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729856 00000100:00100000:3.0:1788797457.066078:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729856 00000100:00100000:3.0:1788797457.066138:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:3.0:1788797457.066149:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729856:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797457.066302:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729856:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 153us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797457.066310:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 124 00000100:00100000:3.0:1788797457.067930:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.069174:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376729984 00000100:00100000:1.0:1788797457.069186:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376729984 00000100:00100000:1.0:1788797457.069246:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:1.0:1788797457.069256:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729984:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797457.069407:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18100:x1875689376729984:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 151us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.069415:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 125 00000100:00100000:0.0:1788797457.080038:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.080137:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730112 00000100:00100000:2.0:1788797457.080147:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730112 00000100:00100000:2.0:1788797457.080204:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:2.0:1788797457.080214:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+8:18081:x1875689376730112:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797457.080233:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797457.080253:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c0031200/0x6418c0ce308ce6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8147 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.080296:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c0031200/0x6418c0ce308ce6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8147 expref: 9 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.080308:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c0031200/0x6418c0ce308ce6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8147 expref: 9 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797457.080318:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c0031200, rc 0) 00000100:00100000:2.0:1788797457.080377:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+9:18081:x1875689376730112:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 164us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.080384:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 126 00000100:00100000:0.0:1788797457.087341:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.087420:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730240 00000100:00100000:3.0:1788797457.087430:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730240 00000100:00100000:3.0:1788797457.087486:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:3.0:1788797457.087495:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+9:18081:x1875689376730240:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788797457.087519:0:22803:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788797457.087541:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788797457.087545:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788797457.087548:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788797457.087555:0:22803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788797457.087558:0:22803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788797457.090071:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c742f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+9:18081:x1875689376730240:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 2567us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.090084:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 127 00000100:00100000:0.0:1788797457.096752:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.096931:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730368 00000100:00100000:1.0:1788797457.096941:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730368 00000100:00100000:1.0:1788797457.097009:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:1.0:1788797457.097019:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+9:18081:x1875689376730368:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788797457.097035:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797457.097052:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca814e expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797457.097082:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 10 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797457.097092:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 10 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797457.097101:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4800, rc 0) 00000100:00100000:1.0:1788797457.097168:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18081:x1875689376730368:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.097175:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 128 00000100:00100000:0.0:1788797457.098935:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.099034:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730496 00000100:00100000:2.0:1788797457.099043:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730496 00000100:00100000:2.0:1788797457.099092:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:2.0:1788797457.099102:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18081:x1875689376730496:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797457.099234:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18081:x1875689376730496:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 133us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.099242:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 129 00000100:00100000:3.0:1788797457.109695:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.109843:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730624 00000100:00100000:2.0:1788797457.109854:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730624 00000100:00100000:2.0:1788797457.109914:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:2.0:1788797457.109925:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18081:x1875689376730624:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788797457.110091:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18081:x1875689376730624:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 167us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.110105:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 130 00000100:00100000:0.0:1788797457.115106:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.115215:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730752 00000100:00100000:1.0:1788797457.115225:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730752 00000100:00100000:1.0:1788797457.115280:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:1.0:1788797457.115290:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18106:x1875689376730752:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797457.115437:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18106:x1875689376730752:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 148us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.115445:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 131 00000100:00100000:0.0:1788797457.130016:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.130299:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376730880 00000100:00100000:3.0:1788797457.130310:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376730880 00000100:00100000:3.0:1788797457.130371:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 132 00000100:00100000:3.0:1788797457.130381:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18106:x1875689376730880:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797457.130566:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18106:x1875689376730880:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 186us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797457.130585:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 132 00010000:00010000:3.0:1788797457.138953:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797457.151371:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797457.151463:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.151709:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731008 00000100:00100000:1.0:1788797457.151718:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731008 00000100:00100000:1.0:1788797457.151752:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731264 00000100:00100000:1.0:1788797457.151755:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731264 00000100:00100000:1.0:1788797457.151784:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1788797457.151826:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875689376731008:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788797457.151858:0:24561:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788797457.151913:0:24561:0:(genops.c:1384:class_connect()) connect: client 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8, cookie 0x6418c0ce308ce6f5 00000004:00100000:1.0:1788797457.151937:0:24561:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788797457.152157:0:24561:0:(import.c:65:import_set_state_nolock()) ffff9a23cb172800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797457.152227:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2403:x1875689376731008:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 401us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.152235:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:1.0:1788797457.152254:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:1.0:1788797457.152259:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875689376731264:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788797457.152273:0:24561:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788797457.152313:0:24561:0:(genops.c:1384:class_connect()) connect: client 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8, cookie 0x6418c0ce308ce6fc 00000004:00100000:1.0:1788797457.152324:0:24561:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788797457.152444:0:24561:0:(import.c:65:import_set_state_nolock()) ffff9a23c7c2b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797457.152468:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2403:x1875689376731264:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 208us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.152474:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:0.0:1788797457.160051:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797457.160084:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797457.160117:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.160203:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731520 00000100:00100000:2.0:1788797457.160213:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731520 00000100:00100000:2.0:1788797457.160284:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731392 00000100:00100000:2.0:1788797457.160288:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731392 00000100:00100000:2.0:1788797457.160303:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731136 00000100:00100000:2.0:1788797457.160305:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731136 00000100:00100000:2.0:1788797457.160320:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1788797457.160328:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18081:x1875689376731520:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797457.160368:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797457.160457:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18081:x1875689376731520:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.160464:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:2.0:1788797457.160480:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1788797457.160486:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:0:x1875689376731392:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797457.160502:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788797457.160536:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:0:x1875689376731392:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.160542:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1788797457.160554:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1788797457.160560:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:0:x1875689376731136:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788797457.160583:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797457.160605:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:0:x1875689376731136:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 45us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.160610:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00080000:0.0:1788797457.161074:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797457.161079:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797457.162139:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797457.162222:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731648 00000100:00100000:2.0:1788797457.162230:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731648 00000100:00100000:2.0:1788797457.162316:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:2.0:1788797457.162327:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376731648:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788797457.162403:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376731648:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797457.162410:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1788797457.164052:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.164156:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732032 00000100:00100000:1.0:1788797457.164165:0:22821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732032 00000100:00100000:1.0:1788797457.164218:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1788797457.164229:0:22821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376732032:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788797457.164299:0:22821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376732032:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.164306:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1788797457.165472:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.165510:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797457.165532:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731776 00000100:00100000:1.0:1788797457.165538:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731776 00000100:00100000:1.0:1788797457.165559:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376731904 00000100:00100000:1.0:1788797457.165561:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376731904 00000100:00100000:1.0:1788797457.165589:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1788797457.165595:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875689376731776:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788797457.165628:0:24712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788797457.165659:0:24712:0:(genops.c:1384:class_connect()) connect: client 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8, cookie 0x6418c0ce308ce703 00002000:00100000:1.0:1788797457.165671:0:24712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8/ffff9a22c327d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797457.165697:0:24712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797457.165916:0:24712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788797457.165946:0:24712:0:(import.c:65:import_set_state_nolock()) ffff9a22c327b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797457.166004:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2403:x1875689376731776:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 407us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.166011:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1788797457.166028:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1788797457.166032:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875689376731904:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788797457.166048:0:24712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1788797457.166064:0:24712:0:(genops.c:1384:class_connect()) connect: client 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8, cookie 0x6418c0ce308ce70a 00002000:00100000:1.0:1788797457.166069:0:24712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8/ffff9a22c327f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797457.166081:0:24712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797457.166200:0:24712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788797457.166218:0:24712:0:(import.c:65:import_set_state_nolock()) ffff9a23ec4a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797457.166245:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2403:x1875689376731904:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 211us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797457.166251:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1788797457.178477:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797457.178929:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732160 00000100:00100000:0.0:1788797457.178939:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732160 00000100:00100000:0.0:1788797457.179005:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1788797457.179015:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376732160:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788797457.184859:0:22813:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5753us 00000004:00200000:0.0:1788797457.193229:0:22813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788797457.193363:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18081:x1875689376732160:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 14343us (14891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797457.193374:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1788797457.398747:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797457.398972:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732288 00000100:00100000:0.0:1788797457.398983:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732288 00000100:00100000:0.0:1788797457.399115:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:0.0:1788797457.399126:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18129:x1875689376732288:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:0.0:1788797457.399149:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797457.399178:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca817f expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399247:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399262:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399295:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797457.399348:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797457.399352:0:22811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797457.399388:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399415:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca817f expref: 8 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399436:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca817f expref: 7 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797457.399444:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:0.0:1788797457.399447:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797457.399451:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901200, rc 0) 00000100:00100000:0.0:1788797457.399566:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18129:x1875689376732288:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 442us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797457.399574:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1788797457.971516:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390488704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797457.971584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797457.971820:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488704 00000100:00100000:0.0:1788797457.971828:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488704 00000100:00100000:0.0:1788797457.971900:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797457.971910:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390488704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797457.971938:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788797457.972000:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390488704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (416us total) trans 0 rc 0/0 00000100:00080000:3.0:1788797457.972019:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797457.972024:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797457.972098:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390488704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788797458.163013:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797458.483063:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797458.483088:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390488832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797458.483171:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797458.483405:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488832 00000100:00100000:3.0:1788797458.483415:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488832 00000100:00100000:3.0:1788797458.483467:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788797458.483476:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390488832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797458.483508:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797458.483553:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390488832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.483559:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797458.483878:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390488960:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.483914:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797458.483939:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390489472:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.483961:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.483972:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.483989:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875689390489984:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797458.484036:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484055:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390489856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.484092:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484094:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484116:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390490368:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484136:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484154:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788797458.484170:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390489216:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484194:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484214:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390489728:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484237:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484255:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875689390490240:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484276:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797458.484299:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489472 00000100:00100000:3.0:1788797458.484305:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489472 00000100:00100000:0.0:1788797458.484306:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489344 00000100:00100000:0.0:1788797458.484312:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489344 00000100:00100000:3.0:1788797458.484341:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797458.484341:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489856 00000100:00100000:0.0:1788797458.484345:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489856 00000100:00100000:0.0:1788797458.484360:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490368 00000100:00100000:3.0:1788797458.484361:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390489472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484364:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490368 00000100:00100000:0.0:1788797458.484389:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490240 00000100:00100000:0.0:1788797458.484393:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490240 00000100:00100000:3.0:1788797458.484409:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390489472:12345-0@lo:400:kworker.0 Request processed in 53us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.484412:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797458.484422:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797458.484424:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390489344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484446:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489088 00000100:00100000:3.0:1788797458.484451:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489088 00000100:00100000:0.0:1788797458.484467:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390489344:12345-0@lo:400:kworker.0 Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.484480:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489216 00000100:00100000:3.0:1788797458.484484:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489216 00000100:00100000:0.0:1788797458.484486:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788797458.484507:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489728 00000100:00100000:0.0:1788797458.484508:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797458.484512:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489728 00000100:00100000:0.0:1788797458.484519:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390489856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484534:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797458.484543:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484554:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875689390489856:12345-0@lo:400:kworker.0 Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.484564:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788797458.484582:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797458.484584:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390489088:12345-0@lo:400:kworker.0 Request processed in 41us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.484591:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875689390490368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484594:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797458.484616:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797458.484624:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390489216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484651:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875689390489216:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.484656:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797458.484666:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797458.484671:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390489728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484695:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390489728:12345-0@lo:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.484700:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788797458.484717:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797458.484720:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788797458.484728:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797458.484730:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788797458.484812:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788797458.484821:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875689390490240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484833:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875689390490368:12345-0@lo:400:kworker.0 Request processed in 242us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.484840:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797458.484860:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875689390490240:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.484866:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788797458.484884:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390489216:0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484892:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.484899:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390489728:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484915:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1875689390490240:0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484924:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390490496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797458.484929:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390489344:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.484937:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875689390489856:0@lo:400:kworker.0 00010000:00080000:0.0:1788797458.484948:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c42b1500 x1875689390490368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797458.484959:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1875689390490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.484971:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.485008:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490496 00000100:00100000:0.0:1788797458.485012:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490496 00000100:00100000:3.0:1788797458.485021:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390489472:0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.485044:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797458.485057:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875689390490496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797458.485079:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788797458.485082:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489984 00000100:00100000:3.0:1788797458.485087:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489984 00000100:00100000:0.0:1788797458.485119:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875689390490496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.485127:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797458.485138:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788797458.485148:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875689390489984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.485184:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875689390489984:12345-0@lo:400:kworker.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.485189:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788797458.485205:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797458.486287:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390490496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797458.486317:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875689390489984:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.486496:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390489088:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.486506:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390489600:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.486553:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797458.486583:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390490112:0@lo:400:kworker.0 00000100:00100000:1.0:1788797458.486604:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797458.487102:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490112 00000100:00100000:0.0:1788797458.487109:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490112 00000100:00100000:0.0:1788797458.487180:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788797458.487188:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390490112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797458.487239:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390490112:12345-0@lo:400:kworker.0 Request processed in 53us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797458.487246:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788797458.488467:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788797458.488515:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c42b3b80 x1875689390490112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797458.488531:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390490112:0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.489444:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390489600 00000100:00100000:3.0:1788797458.489457:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390489600 00000100:00100000:3.0:1788797458.489519:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797458.489530:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797458.489619:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390489600:12345-0@lo:400:kworker.0 Request processed in 91us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.489625:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797458.489827:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390490752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797458.489868:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797458.489912:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390488832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797458.489940:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490752 00000100:00100000:2.0:1788797458.489943:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490752 00000100:00100000:2.0:1788797458.489973:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797458.489994:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390490752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788797458.490008:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788797458.490048:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390489600:0@lo:400:kworker.0 00000100:00100000:2.0:1788797458.490049:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390490752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797458.490061:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797458.490076:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390490624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797458.490096:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390490752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797458.490111:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797458.490169:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390488960 00000100:00100000:2.0:1788797458.490174:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390488960 00000100:00100000:2.0:1788797458.490213:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788797458.490221:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3618:x1875689390488960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797458.490256:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3618:x1875689390488960:12345-0@lo:400:kworker.0 Request processed in 36us (6341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797458.490262:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788797458.491759:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490624 00000100:00100000:3.0:1788797458.491779:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490624 00000100:00100000:3.0:1788797458.491850:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788797458.491859:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390490624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797458.491892:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797458.491966:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390490624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797458.491974:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788797458.492019:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390490624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797458.492030:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390488960:0@lo:400:kworker.0 00000040:00080000:2.0:1788797458.740054:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788797459.000829:0:25138:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8 00000001:00080000:2.0:1788797459.000847:0:25138:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1788797459.187124:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797459.492675:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.496264:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732416 00000100:00100000:0.0:1788797459.496281:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732416 00000100:00100000:0.0:1788797459.496457:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:0.0:1788797459.496470:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18181:x1875689376732416:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:0.0:1788797459.496508:0:22810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797459.496619:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18181:x1875689376732416:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 152us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.496639:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00080000:1.0:1788797459.497922:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797459.499758:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.499880:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732544 00000100:00100000:0.0:1788797459.499890:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732544 00000100:00080000:1.0:1788797459.500206:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788797459.500349:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:0.0:1788797459.500372:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18181:x1875689376732544:12345-192.168.202.33@tcp:41:lfs.0 00000004:00000024:0.0:1788797459.500411:0:24561:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797459.500515:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18181:x1875689376732544:12345-192.168.202.33@tcp:41:lfs.0 Request processed in 156us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.500523:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1788797459.504098:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797459.504376:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732672 00000100:00100000:3.0:1788797459.504386:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732672 00000100:00100000:3.0:1788797459.504581:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1788797459.504593:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18181:x1875689376732672:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:3.0:1788797459.504648:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797459.504732:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18181:x1875689376732672:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 141us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797459.504740:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00080000:1.0:1788797459.504831:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797459.508422:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797459.508624:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732800 00000100:00100000:3.0:1788797459.508635:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732800 00000100:00100000:3.0:1788797459.508713:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:3.0:1788797459.508724:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18181:x1875689376732800:12345-192.168.202.33@tcp:13:lfs.0 00002000:00000024:3.0:1788797459.508747:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788797459.508855:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18181:x1875689376732800:12345-192.168.202.33@tcp:13:lfs.0 Request processed in 133us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797459.508862:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00080000:1.0:1788797459.509066:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797459.755288:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797459.756183:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376732928 00000100:00100000:1.0:1788797459.756196:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376732928 00000100:00100000:1.0:1788797459.756261:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:1.0:1788797459.756272:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+10:18213:x1875689376732928:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788797459.756290:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797459.756310:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c12e5800/0x6418c0ce308ce71f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8186 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.756342:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c12e5800/0x6418c0ce308ce71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8186 expref: 11 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.756373:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c12e5800/0x6418c0ce308ce71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8186 expref: 11 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.756382:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5800, rc 0) 00000100:00100000:1.0:1788797459.756504:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376732928:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 233us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797459.756511:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 134 00000100:00100000:0.0:1788797459.773103:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.773264:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733056 00000100:00100000:2.0:1788797459.773274:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733056 00000100:00100000:2.0:1788797459.773335:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:2.0:1788797459.773346:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376733056:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797459.773508:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376733056:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 164us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797459.773516:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 135 00000100:00100000:2.0:1788797459.778596:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.784748:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733184 00000100:00100000:0.0:1788797459.784763:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733184 00000100:00100000:0.0:1788797459.784847:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:0.0:1788797459.784856:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376733184:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788797459.785032:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376733184:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 176us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.785040:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 136 00000100:00100000:0.0:1788797459.806639:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797459.807263:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733312 00000100:00100000:1.0:1788797459.807276:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733312 00000100:00100000:1.0:1788797459.807336:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:1.0:1788797459.807347:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733312:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797459.807514:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733312:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 169us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797459.807522:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 137 00000100:00100000:1.0:1788797459.821885:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.822089:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733440 00000100:00100000:2.0:1788797459.822099:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733440 00000100:00100000:2.0:1788797459.822151:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1788797459.822160:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733440:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788797459.822319:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733440:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 159us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797459.822333:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 138 00000100:00100000:2.0:1788797459.832623:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.840295:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733568 00000100:00100000:0.0:1788797459.840309:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733568 00000100:00100000:0.0:1788797459.840367:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:0.0:1788797459.840374:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733568:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797459.840567:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18220:x1875689376733568:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 193us (7954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.840581:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 139 00000100:00100000:0.0:1788797459.843984:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797459.844260:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733696 00000100:00100000:1.0:1788797459.844268:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733696 00000100:00100000:1.0:1788797459.844313:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:1.0:1788797459.844320:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18213:x1875689376733696:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788797459.844334:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797459.844350:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c12e5a00/0x6418c0ce308ce726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca81b7 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.844373:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c12e5a00/0x6418c0ce308ce726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81b7 expref: 12 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.844397:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c12e5a00/0x6418c0ce308ce726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81b7 expref: 12 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797459.844404:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5a00, rc 0) 00000100:00100000:1.0:1788797459.844488:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18213:x1875689376733696:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 167us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797459.844496:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 140 00000100:00100000:1.0:1788797459.847427:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.847482:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733824 00000100:00100000:2.0:1788797459.847491:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733824 00000100:00100000:2.0:1788797459.847554:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:2.0:1788797459.847562:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18213:x1875689376733824:12345-192.168.202.33@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788797459.847583:0:22805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788797459.847604:0:22805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788797459.847607:0:22805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788797459.847609:0:22805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788797459.847611:0:22805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788797459.847613:0:22805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788797459.849035:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18213:x1875689376733824:12345-192.168.202.33@tcp:256:mount.lustre.0 Request processed in 1466us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.849047:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 141 00000100:00100000:1.0:1788797459.851252:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.851376:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376733952 00000100:00100000:0.0:1788797459.851386:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376733952 00000100:00100000:0.0:1788797459.851430:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00100000:0.0:1788797459.851437:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18213:x1875689376733952:12345-192.168.202.33@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788797459.851451:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797459.851465:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca81be expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797459.851488:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 13 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797459.851499:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 13 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797459.851506:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901400, rc 0) 00000100:00100000:0.0:1788797459.851654:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18213:x1875689376733952:12345-192.168.202.33@tcp:101:mount.lustre.0 Request processed in 217us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.851659:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 142 00000100:00100000:1.0:1788797459.852770:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.852912:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734080 00000100:00100000:0.0:1788797459.852918:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734080 00000100:00100000:0.0:1788797459.852984:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:0.0:1788797459.852998:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18213:x1875689376734080:12345-192.168.202.33@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788797459.853231:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18213:x1875689376734080:12345-192.168.202.33@tcp:501:mount.lustre.0 Request processed in 237us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.853239:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 143 00000100:00100000:2.0:1788797459.854152:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.854294:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734208 00000100:00100000:0.0:1788797459.854300:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734208 00000100:00100000:0.0:1788797459.854330:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:0.0:1788797459.854339:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18213:x1875689376734208:12345-192.168.202.33@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788797459.854430:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18213:x1875689376734208:12345-192.168.202.33@tcp:503:mount.lustre.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.854437:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 144 00000100:00100000:1.0:1788797459.855920:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.856222:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734336 00000100:00100000:0.0:1788797459.856228:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734336 00000100:00100000:0.0:1788797459.856268:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:0.0:1788797459.856276:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18224:x1875689376734336:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797459.856382:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18224:x1875689376734336:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 107us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.856389:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 145 00000100:00100000:1.0:1788797459.858939:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.859147:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734464 00000100:00100000:0.0:1788797459.859157:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734464 00000100:00100000:0.0:1788797459.859215:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:0.0:1788797459.859226:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18224:x1875689376734464:12345-192.168.202.33@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797459.859375:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18224:x1875689376734464:12345-192.168.202.33@tcp:502:llog_process_th.0 Request processed in 149us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.859382:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 146 00000100:00100000:2.0:1788797459.869840:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.870184:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.870284:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734592 00000100:00100000:0.0:1788797459.870295:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734592 00000100:00100000:0.0:1788797459.870340:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734848 00000100:00100000:0.0:1788797459.870344:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734848 00000100:00100000:0.0:1788797459.870381:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1788797459.870389:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875689376734592:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788797459.870420:0:22810:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 62a16f93-c353-4076-bef0-cc464ba0d33d@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1788797459.870478:0:22810:0:(genops.c:1384:class_connect()) connect: client 62a16f93-c353-4076-bef0-cc464ba0d33d, cookie 0x6418c0ce308ce734 00000004:00100000:0.0:1788797459.870502:0:22810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788797459.870608:0:22810:0:(import.c:65:import_set_state_nolock()) ffff9a22c2308800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797459.870674:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2403:x1875689376734592:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 284us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.870682:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:0.0:1788797459.870701:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1788797459.870706:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875689376734848:12345-192.168.202.33@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788797459.870912:0:22810:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 62a16f93-c353-4076-bef0-cc464ba0d33d@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1788797459.870937:0:22810:0:(genops.c:1384:class_connect()) connect: client 62a16f93-c353-4076-bef0-cc464ba0d33d, cookie 0x6418c0ce308ce73b 00000004:00100000:0.0:1788797459.870949:0:22810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788797459.871005:0:22810:0:(import.c:65:import_set_state_nolock()) ffff9a22c230c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797459.871030:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2403:x1875689376734848:12345-192.168.202.33@tcp:38:mount.lustre.0 Request processed in 323us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.871037:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:2.0:1788797459.880600:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.880689:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.882254:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.882369:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735104 00000100:00100000:0.0:1788797459.882380:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735104 00000100:00100000:0.0:1788797459.882462:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734976 00000100:00100000:0.0:1788797459.882466:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734976 00000100:00100000:0.0:1788797459.882507:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1788797459.882540:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735104:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788797459.882599:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797459.882669:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735104:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 130us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.882677:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1788797459.882697:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1788797459.882705:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:0:x1875689376734976:12345-192.168.202.33@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788797459.882717:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797459.882745:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:0:x1875689376734976:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 40us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.882751:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:0.0:1788797459.883574:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376734720 00000100:00100000:0.0:1788797459.883581:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376734720 00000100:00100000:0.0:1788797459.883659:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:0.0:1788797459.883667:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:0:x1875689376734720:12345-192.168.202.33@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788797459.883682:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1788797459.883684:0:22812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:1.0:1788797459.883686:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797459.883728:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:0:x1875689376734720:12345-192.168.202.33@tcp:41:mount.lustre.0 Request processed in 61us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.883735:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1788797459.889503:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797459.889631:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735232 00000100:00100000:0.0:1788797459.889641:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735232 00000100:00100000:0.0:1788797459.889749:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:0.0:1788797459.889761:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735232:12345-192.168.202.33@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788797459.890153:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735232:12345-192.168.202.33@tcp:40:mount.lustre.0 Request processed in 393us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797459.890172:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1788797459.894241:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797459.894273:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797459.894288:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735360 00000100:00100000:3.0:1788797459.894297:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735360 00000100:00100000:1.0:1788797459.894313:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797459.894346:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735488 00000100:00100000:3.0:1788797459.894349:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735488 00000100:00100000:2.0:1788797459.894436:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735616 00000100:00100000:2.0:1788797459.894441:0:22821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735616 00000100:00100000:3.0:1788797459.894484:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:1.0:1788797459.894492:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:3.0:1788797459.894493:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875689376735360:12345-192.168.202.33@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788797459.894497:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875689376735488:12345-192.168.202.33@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788797459.894526:0:24712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 62a16f93-c353-4076-bef0-cc464ba0d33d@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00010000:00080000:1.0:1788797459.894526:0:24320:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 62a16f93-c353-4076-bef0-cc464ba0d33d@192.168.202.33@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:3.0:1788797459.894557:0:24712:0:(genops.c:1384:class_connect()) connect: client 62a16f93-c353-4076-bef0-cc464ba0d33d, cookie 0x6418c0ce308ce749 00000020:00000080:1.0:1788797459.894564:0:24320:0:(genops.c:1384:class_connect()) connect: client 62a16f93-c353-4076-bef0-cc464ba0d33d, cookie 0x6418c0ce308ce742 00002000:00100000:3.0:1788797459.894569:0:24712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62a16f93-c353-4076-bef0-cc464ba0d33d/ffff9a24015d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788797459.894569:0:24320:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62a16f93-c353-4076-bef0-cc464ba0d33d/ffff9a22c2248800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788797459.894579:0:24712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788797459.894579:0:24320:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788797459.894635:0:24320:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:3.0:1788797459.894636:0:24712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788797459.894664:0:24712:0:(import.c:65:import_set_state_nolock()) ffff9a22c33dc800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788797459.894664:0:24320:0:(import.c:65:import_set_state_nolock()) ffff9a22c224b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797459.894721:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2403:x1875689376735360:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 229us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797459.894729:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:1.0:1788797459.894729:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2403:x1875689376735488:12345-192.168.202.33@tcp:8:mount.lustre.0 Request processed in 232us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797459.894735:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:2.0:1788797459.895055:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1788797459.895064:0:22821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735616:12345-192.168.202.33@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788797459.895107:0:22821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735616:12345-192.168.202.33@tcp:900:mount.lustre.0 Request processed in 45us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797459.895113:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:1.0:1788797459.898282:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797459.898365:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735744 00000100:00100000:2.0:1788797459.898372:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735744 00000100:00100000:2.0:1788797459.898443:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:2.0:1788797459.898451:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735744:12345-192.168.202.33@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788797459.898536:0:22814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788797459.898616:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18213:x1875689376735744:12345-192.168.202.33@tcp:33:mount.lustre.0 Request processed in 166us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797459.898621:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:1.0:1788797460.069430:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797460.069718:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376735872 00000100:00100000:2.0:1788797460.069730:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376735872 00000100:00100000:2.0:1788797460.069813:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:2.0:1788797460.069904:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18247:x1875689376735872:12345-192.168.202.33@tcp:101:mkdir.0 00010000:00010000:2.0:1788797460.069928:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797460.069953:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031600/0x6418c0ce308ce750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca81ef expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070031:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070045:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070056:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797460.070096:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788797460.070099:0:24561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788797460.070120:0:24561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070162:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031600/0x6418c0ce308ce750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 8 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070194:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 7 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797460.070202:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:2.0:1788797460.070205:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788797460.070209:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c0031400, rc 0) 00000100:00100000:2.0:1788797460.070408:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+7:18247:x1875689376735872:12345-192.168.202.33@tcp:101:mkdir.0 Request processed in 586us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797460.070416:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00010000:00010000:2.0:1788797460.211181:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797461.042986:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797461.043009:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797461.043079:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797461.043165:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390490880 00000100:00100000:2.0:1788797461.043174:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390490880 00000100:00100000:2.0:1788797461.043238:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788797461.043249:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390490880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797461.043271:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788797461.043318:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390490880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797461.043325:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788797461.043370:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390490880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788797461.043427:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788797461.236090:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797462.262145:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797463.091885:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390491008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788797463.091975:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797463.092219:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491008 00000100:00100000:2.0:1788797463.092228:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491008 00000100:00100000:2.0:1788797463.092283:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788797463.092292:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390491008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788797463.092328:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788797463.092375:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390491008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797463.092381:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788797463.092402:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797463.092737:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390491008:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788797463.094498:0:22790:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62a16f93-c353-4076-bef0-cc464ba0d33d 00000001:00100000:1.0:1788797463.094515:0:22790:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8 00000001:00100000:2.0:1788797463.094614:0:24315:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62a16f93-c353-4076-bef0-cc464ba0d33d 00000001:00100000:2.0:1788797463.094621:0:24315:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8 00000001:00100000:1.0:1788797463.107571:0:23544:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62a16f93-c353-4076-bef0-cc464ba0d33d 00000001:00100000:1.0:1788797463.107583:0:23544:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e002fc6-6c57-4c3f-b3af-ceff1e7642d8 00000001:02000400:0.0:1788797463.235539:0:25705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788797463.288818:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797463.606265:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797463.606291:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390491136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797463.606376:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797463.606452:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491136 00000100:00100000:2.0:1788797463.606459:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491136 00000100:00100000:2.0:1788797463.606526:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788797463.606536:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390491136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788797463.606565:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788797463.606609:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390491136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797463.606617:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788797463.606638:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797463.606675:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390491136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797463.607209:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797463.607222:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390491264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797463.607261:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.607318:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491264 00000100:00100000:0.0:1788797463.607323:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491264 00000100:00100000:0.0:1788797463.607356:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788797463.607364:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390491264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797463.607390:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797463.607424:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390491264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.607431:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788797463.607454:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c33b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390491392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797463.607479:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.607506:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390491264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797463.607541:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491392 00000100:00100000:0.0:1788797463.607544:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491392 00000100:00100000:0.0:1788797463.607577:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797463.607582:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390491392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797463.607593:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1788797463.607621:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390491392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.607627:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788797463.607644:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788797463.607675:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788797463.607689:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c33b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390491392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797463.608022:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390491648:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608051:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608077:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390492160:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608099:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608124:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390492672:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608145:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608163:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788797463.608168:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608193:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608215:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608235:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608250:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390492544:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608269:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608295:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492160 00000100:00100000:0.0:1788797463.608300:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492160 00000100:00100000:0.0:1788797463.608326:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492672 00000100:00100000:0.0:1788797463.608328:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492672 00000100:00100000:0.0:1788797463.608342:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492544 00000100:00100000:0.0:1788797463.608344:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492544 00000100:00100000:0.0:1788797463.608357:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797463.608363:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390492160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608402:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875689390492160:12345-0@lo:400:kworker.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.608407:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797463.608428:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788797463.608434:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390492672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608462:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875689390492672:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.608466:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788797463.608477:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788797463.608482:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875689390492544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608506:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875689390492544:12345-0@lo:400:kworker.0 Request processed in 23us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.608522:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788797463.608541:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491520 00000100:00100000:0.0:1788797463.608544:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491520 00000100:00100000:0.0:1788797463.608565:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788797463.608571:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3619:x1875689390491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608599:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3619:x1875689390491520:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.608604:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788797463.608634:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797463.608637:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788797463.608646:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608668:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608684:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608702:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608717:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788797463.608723:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390491776:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608742:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608766:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390492288:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608815:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608831:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390492800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797463.608850:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797463.608871:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492416 00000100:00100000:0.0:1788797463.608875:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492416 00000100:00100000:0.0:1788797463.608898:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491776 00000100:00100000:0.0:1788797463.608901:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491776 00000100:00100000:0.0:1788797463.608910:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492288 00000100:00100000:0.0:1788797463.608912:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492288 00000100:00100000:0.0:1788797463.608924:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788797463.608941:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390492416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.608975:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875689390492416:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.608981:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788797463.608993:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788797463.608998:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390491776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609023:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875689390491776:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.609029:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788797463.609040:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797463.609045:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609069:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875689390492288:12345-0@lo:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.609074:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788797463.609090:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797463.609092:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788797463.609106:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491904 00000100:00100000:0.0:1788797463.609109:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491904 00000100:00100000:0.0:1788797463.609132:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492800 00000100:00100000:0.0:1788797463.609135:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492800 00000100:00100000:0.0:1788797463.609146:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797463.609151:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875689390491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609183:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875689390491904:12345-0@lo:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.609188:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797463.609200:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788797463.609205:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390492800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797463.609225:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797463.609251:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390492800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797463.609256:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788797463.609291:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42e4a701-62a9-467c-87db-46cabbbe5ca1:3619:1875689390491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609301:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390492544:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609309:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875689390492160:0@lo:400:kworker.0 00010000:00080000:0.0:1788797463.609320:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c2d99f80 x1875689390492672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797463.609329:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1875689390492672:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609363:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875689390491776:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609372:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1875689390492288:0@lo:400:kworker.0 00000100:00100000:0.0:1788797463.609382:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390492800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797463.609399:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390491904:0@lo:400:kworker.0 00010000:00080000:0.0:1788797463.609408:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23f9088e00 x1875689390492416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797463.609416:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1875689390492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788797463.609609:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390491648 00000100:00100000:3.0:1788797463.609614:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390491648 00000100:00100000:3.0:1788797463.609654:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492032 00000100:00100000:3.0:1788797463.609658:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492032 00000100:00100000:3.0:1788797463.609677:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797463.609684:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390491648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797463.609727:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390491648:12345-0@lo:400:kworker.0 Request processed in 44us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797463.609742:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797463.609754:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797463.609759:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797463.609811:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390492032:12345-0@lo:400:kworker.0 Request processed in 26us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797463.609817:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797463.609847:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788797463.609857:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390491648:0@lo:400:kworker.0 00000100:00080000:0.0:1788797463.610217:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788797464.311684:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797464.567727:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788797465.331045:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797465.375022:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.375075:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797465.375179:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736000 00000100:00100000:1.0:1788797465.375189:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736000 00000100:00100000:1.0:1788797465.375285:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:1.0:1788797465.375297:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2406:x1875689376736000:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797465.375375:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2406:x1875689376736000:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797465.375382:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 148 00000100:00100000:0.0:1788797465.376513:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736128 00000100:00100000:0.0:1788797465.376522:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736128 00000100:00080000:2.0:1788797465.376618:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797465.376753:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:0.0:1788797465.376764:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2406:x1875689376736128:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797465.376855:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2406:x1875689376736128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797465.376863:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1788797465.386215:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386261:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386285:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386304:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386319:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386334:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386373:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797465.386402:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736256 00000100:00100000:3.0:1788797465.386411:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736256 00000100:00100000:3.0:1788797465.386455:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736768 00000100:00100000:3.0:1788797465.386457:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736768 00000100:00100000:3.0:1788797465.386468:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736640 00000100:00100000:3.0:1788797465.386470:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736640 00000100:00100000:3.0:1788797465.386486:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:3.0:1788797465.386506:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736256:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797465.386592:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797465.386600:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:3.0:1788797465.386617:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1788797465.386624:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2406:x1875689376736768:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797465.386648:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2406:x1875689376736768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797465.386653:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1788797465.386665:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1788797465.386672:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2406:x1875689376736640:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797465.386694:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2406:x1875689376736640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797465.386700:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1788797465.386718:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736512 00000100:00100000:3.0:1788797465.386721:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736512 00000100:00100000:3.0:1788797465.386739:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737024 00000100:00100000:3.0:1788797465.386741:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737024 00000100:00100000:3.0:1788797465.386750:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736384 00000100:00100000:3.0:1788797465.386752:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736384 00000100:00100000:3.0:1788797465.386762:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376736896 00000100:00100000:3.0:1788797465.386764:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376736896 00000100:00100000:3.0:1788797465.386775:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1788797465.386780:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736512:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797465.386831:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 50us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797465.386847:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:3.0:1788797465.386861:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1788797465.386867:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2406:x1875689376737024:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797465.386889:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2406:x1875689376737024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 22us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797465.386999:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1788797465.387009:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736384:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797465.387039:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2406:x1875689376736384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 33us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797465.387044:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:2.0:1788797465.387056:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1788797465.387061:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2406:x1875689376736896:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797465.387078:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2406:x1875689376736896:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 17us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797465.387084:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:3.0:1788797465.387435:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00080000:3.0:1788797465.388159:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788797465.388165:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797465.388168:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797465.388170:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797466.164005:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390492928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788797466.164081:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797466.164141:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390492928 00000100:00100000:1.0:1788797466.164149:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390492928 00000100:00100000:1.0:1788797466.164209:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788797466.164218:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390492928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797466.164249:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797466.164304:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390492928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797466.164310:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788797466.164331:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797466.164367:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390492928:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788797466.174666:0:25138:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62a16f93-c353-4076-bef0-cc464ba0d33d 00010000:00010000:3.0:1788797466.354944:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797467.378971:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788797467.656678:0:25852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe313cfa30 20000000:00000080:2.0:1788797467.656695:0:25852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a22c409bc00 uarg=0000000000000000 20000000:01000000:2.0:1788797467.656736:0:25852:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788797467.656742:0:25852:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788797467.656746:0:25852:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788797467.657330:0:25853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788797467.657479:0:25852:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788797467.663086:0:25852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788797467.663200:0:25852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663222:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 23 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663230:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663238:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663245:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663256:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663274:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663281:0:25852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663326:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 12 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663344:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 12 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663362:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493056:192.168.202.33@tcp:104: 00010000:00010000:3.0:1788797467.663512:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663521:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663529:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493184:192.168.202.33@tcp:104: 00010000:00010000:3.0:1788797467.663558:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663567:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663576:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493312:0@lo:104: 00000100:00100000:3.0:1788797467.663612:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797467.663669:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663677:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 23 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663685:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493440:0@lo:104: 00000100:00100000:3.0:1788797467.663707:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797467.663739:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663748:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 23 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663756:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493568:0@lo:104: 00000100:00100000:3.0:1788797467.663774:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797467.663823:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 23 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.663831:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 23 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.663839:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493696:0@lo:104: 00000100:00100000:3.0:1788797467.663860:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797467.663877:0:25852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c4206c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797467.663980:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493312 00000100:00100000:2.0:1788797467.663990:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493312 00000100:00100000:2.0:1788797467.664032:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493440 00000100:00100000:2.0:1788797467.664034:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493440 00000100:00100000:2.0:1788797467.664044:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493568 00000100:00100000:2.0:1788797467.664046:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493568 00000100:00100000:2.0:1788797467.664054:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493696 00000100:00100000:2.0:1788797467.664056:0:22794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493696 00000100:00100000:2.0:1788797467.664069:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797467.664079:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:25852:x1875689390493312:12345-0@lo:104: 00010000:00010000:2.0:1788797467.664093:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664151:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797467.664157:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+6:25852:x1875689390493312:12345-0@lo:104: Request processed in 80us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.664164:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797467.664181:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797467.664187:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:25852:x1875689390493440:12345-0@lo:104: 00010000:00010000:2.0:1788797467.664194:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664224:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797467.664228:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+5:25852:x1875689390493440:12345-0@lo:104: Request processed in 42us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.664234:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797467.664245:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797467.664250:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:25852:x1875689390493568:12345-0@lo:104: 00010000:00010000:2.0:1788797467.664257:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664282:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788797467.664287:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+4:25852:x1875689390493568:12345-0@lo:104: Request processed in 38us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.664292:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797467.664303:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797467.664308:0:22794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:25852:x1875689390493696:12345-0@lo:104: 00010000:00010000:2.0:1788797467.664315:0:22794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664350:0:22794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788797467.664355:0:22794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+3:25852:x1875689390493696:12345-0@lo:104: Request processed in 47us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.664361:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788797467.664377:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788797467.664383:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664390:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900c00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797467.664394:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664403:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797467.664411:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797467.664417:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797467.664445:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664452:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797467.664470:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664476:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a22c3900c00/0x6418c0ce308ce582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce589 expref: -99 pid: 25137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664499:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788797467.664503:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664509:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2402045000 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797467.664512:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664520:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797467.664526:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797467.664531:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797467.664544:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664549:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797467.664556:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664562:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2402045000/0x6418c0ce308ce401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce408 expref: -99 pid: 24314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664572:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797467.664575:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664590:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084be00 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797467.664593:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664600:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797467.664606:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797467.664611:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797467.664621:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664626:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797467.664640:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664646:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a240084be00/0x6418c0ce308ce3c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3c9 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664655:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797467.664658:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664662:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515800 already unused, calling callback (ffffffffc14aec20) 10000000:00010000:2.0:1788797467.664665:0:22799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664683:0:22799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797467.664690:0:22799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797467.664695:0:22799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797467.664708:0:22799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664714:0:22799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797467.664721:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664728:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.133@tcp lock: ffff9a2401515800/0x6418c0ce308ce3b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6418c0ce308ce3bb expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.664740:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797467.664742:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797467.664743:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797467.664750:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797467.664755:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797467.664772:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390493824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.664829:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797467.664852:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797467.664858:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390493952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.664878:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797467.664913:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390494080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.664942:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797467.664957:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797467.664961:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390494208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.664979:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797467.665003:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493824 00000100:00100000:2.0:1788797467.665007:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493824 00010000:00010000:2.0:1788797467.665026:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 24 pid: 22805 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.665040:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390493952 00000100:00100000:2.0:1788797467.665042:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390493952 00010000:00010000:2.0:1788797467.665052:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 25 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.665062:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494080 00000100:00100000:2.0:1788797467.665064:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494080 00010000:00010000:2.0:1788797467.665074:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 26 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.665084:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494208 00000100:00100000:2.0:1788797467.665086:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494208 00010000:00010000:2.0:1788797467.665095:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 27 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.665105:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797467.665111:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+27:3618:x1875689390493824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797467.665120:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797467.665125:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 27 pid: 22805 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665145:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 27 pid: 22805 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665161:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797467.665188:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+27:3618:x1875689390493824:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.665194:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797467.665207:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797467.665213:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+26:3618:x1875689390493952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797467.665220:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797467.665223:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 26 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665232:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 26 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665240:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797467.665259:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+26:3618:x1875689390493952:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.665265:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797467.665275:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797467.665281:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:3616:x1875689390494080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797467.665287:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797467.665291:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 25 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665299:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 25 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665316:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797467.665339:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+25:3616:x1875689390494080:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.665345:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797467.665357:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797467.665363:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3616:x1875689390494208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788797467.665369:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797467.665373:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 24 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665381:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 24 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.665390:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797467.665407:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3616:x1875689390494208:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.665412:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797467.665440:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390494208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.665447:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390494080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.665468:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390493952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797467.665475:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390493824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797467.665877:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce582 expref: 23 pid: 22805 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.665902:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493312:0@lo:104: 00010000:00010000:3.0:1788797467.665913:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a2401514600/0x6418c0ce308ce408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce401 expref: 22 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.665929:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493440:0@lo:104: 00010000:00010000:3.0:1788797467.665941:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e9600/0x6418c0ce308ce3c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce3c2 expref: 21 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.665948:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493568:0@lo:104: 00010000:00010000:3.0:1788797467.665956:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c49e8a00/0x6418c0ce308ce3bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6418c0ce308ce3b4 expref: 20 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797467.665964:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493696:0@lo:104: 00010000:00010000:0.0:1788797467.666032:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797467.669222:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797467.669327:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797467.669376:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493056:192.168.202.33@tcp:104: 00000100:00100000:0.0:1788797467.669388:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1875689390493184:192.168.202.33@tcp:104: 00010000:00010000:0.0:1788797467.669429:0:25852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.670189:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737152 00000100:00100000:2.0:1788797467.670198:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737152 00010000:00010000:2.0:1788797467.670235:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 13 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.670294:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737280 00000100:00100000:2.0:1788797467.670297:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737280 00010000:00010000:2.0:1788797467.670311:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 14 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797467.670324:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:2.0:1788797467.670333:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c7500850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+14:2405:x1875689376737152:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797467.670346:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797467.670351:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 14 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.670363:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 14 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.670381:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a22c3901400/0x6418c0ce308ce72d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81be expref: 14 pid: 22803 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797467.670395:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797467.670440:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c7500850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2405:x1875689376737152:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 109us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797467.670448:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:3.0:1788797467.670563:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:3.0:1788797467.670573:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:2407:x1875689376737280:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797467.670581:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797467.670587:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670596:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670607:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a23c12e4800/0x6418c0ce308ce6ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca814e expref: 12 pid: 22804 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670619:0:22797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670628:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670649:0:22797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670656:0:22797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670662:0:22797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670669:0:22797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670675:0:22797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:3.0:1788797467.670680:0:22797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670689:0:22797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670702:0:22797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797467.670713:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797467.670733:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:2407:x1875689376737280:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 162us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797467.670740:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00010000:00010000:0.0:1788797467.670938:0:25852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797467.670947:0:25852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797467.670954:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a24021de200/0x6418c0ce308ce75e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797468.211640:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797468.211665:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390494336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797468.211746:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797468.212922:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494336 00000100:00100000:1.0:1788797468.212933:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494336 00000100:00100000:1.0:1788797468.213028:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788797468.213039:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390494336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797468.213076:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797468.213147:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390494336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.213153:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788797468.214051:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797468.214107:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390494336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788797468.403178:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797468.723019:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390494848:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723063:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390494976:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723302:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723350:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390495488:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723393:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723411:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390496000:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723432:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390494720:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723460:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:3.0:1788797468.723465:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390494592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797468.723475:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723488:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797468.723494:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390495232:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723501:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390494464:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723513:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723526:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797468.723530:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390495744:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723548:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723550:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390495104:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723561:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390496256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797468.723566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797468.723577:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723579:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875689390495616:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723591:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788797468.723595:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797468.723597:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390495360:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723604:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390496128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797468.723615:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723618:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723639:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495488 00000100:00100000:2.0:1788797468.723639:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a2401699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875689390495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788797468.723646:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495488 00000100:00100000:2.0:1788797468.723658:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797468.723681:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496000 00000100:00100000:3.0:1788797468.723683:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496000 00000100:00100000:2.0:1788797468.723697:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494720 00000100:00100000:2.0:1788797468.723700:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494720 00000100:00100000:3.0:1788797468.723705:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495744 00000100:00100000:3.0:1788797468.723707:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495744 00000100:00100000:3.0:1788797468.723717:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495104 00000100:00100000:2.0:1788797468.723718:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495232 00000100:00100000:3.0:1788797468.723720:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495104 00000100:00100000:2.0:1788797468.723720:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495232 00000100:00100000:3.0:1788797468.723729:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495616 00000100:00100000:2.0:1788797468.723729:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496256 00000100:00100000:3.0:1788797468.723731:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495616 00000100:00100000:2.0:1788797468.723731:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496256 00000100:00100000:2.0:1788797468.723739:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496128 00000100:00100000:3.0:1788797468.723741:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495872 00000100:00100000:2.0:1788797468.723741:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496128 00000100:00100000:3.0:1788797468.723742:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495872 00000100:00100000:2.0:1788797468.723752:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797468.723754:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797468.723760:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390495488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723760:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875689390494720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723830:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875689390494720:12345-0@lo:400:kworker.0 Request processed in 70us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797468.723837:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788797468.723854:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788797468.723868:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875689390495232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.723909:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875689390495232:12345-0@lo:400:kworker.0 Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797468.723914:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788797468.723926:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788797468.723932:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390496256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788797468.723954:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788797468.723983:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875689390496256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797468.723989:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788797468.724016:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788797468.724023:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390496128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797468.724037:0:22815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788797468.724049:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494976 00000100:00100000:1.0:1788797468.724054:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494976 00000100:00100000:1.0:1788797468.724081:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390495360 00000100:00100000:1.0:1788797468.724085:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390495360 00000100:00100000:1.0:1788797468.731084:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797468.731117:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390494976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731215:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390494976:12345-0@lo:400:kworker.0 Request processed in 115us (7913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731223:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797468.731255:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797468.731263:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390495360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731298:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390495360:12345-0@lo:400:kworker.0 Request processed in 36us (7681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731323:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797468.731358:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788797468.731366:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390496000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731400:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875689390496000:12345-0@lo:400:kworker.0 Request processed in 34us (7964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731405:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788797468.731425:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788797468.731431:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390495744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731459:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875689390495744:12345-0@lo:400:kworker.0 Request processed in 29us (7909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731464:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788797468.731478:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797468.731484:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390495104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731514:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875689390495104:12345-0@lo:400:kworker.0 Request processed in 30us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731519:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797468.731533:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797468.731540:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875689390495616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731567:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875689390495616:12345-0@lo:400:kworker.0 Request processed in 28us (7971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731573:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797468.731584:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788797468.731592:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875689390495872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.731617:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875689390495872:12345-0@lo:400:kworker.0 Request processed in 27us (7958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731629:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788797468.731669:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494592 00000100:00100000:1.0:1788797468.731678:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494592 00000100:00100000:1.0:1788797468.731725:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797468.731731:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390494592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797468.731754:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797468.731836:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390494592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (8346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.731842:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788797468.733053:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797468.733063:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788797468.733066:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797468.733123:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390495360:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733147:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1875689390495872:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733160:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733172:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390495232:0@lo:400:kworker.0 00010000:00080000:1.0:1788797468.733186:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a23c6d99500 x1875689390495744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797468.733197:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1875689390495744:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733215:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390496256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797468.733244:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788797468.733254:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390496384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797468.733307:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797468.733372:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496384 00000100:00100000:1.0:1788797468.733380:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496384 00000100:00100000:1.0:1788797468.733417:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788797468.733426:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390496384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788797468.733446:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797468.733487:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390496384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.733494:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788797468.733532:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390496384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797468.733571:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494464 00000100:00100000:1.0:1788797468.733575:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494464 00000100:00100000:1.0:1788797468.733612:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788797468.733620:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:3618:x1875689390494464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733652:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:3618:x1875689390494464:12345-0@lo:400:kworker.0 Request processed in 33us (10125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.733658:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788797468.733708:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390494592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797468.733718:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42e4a701-62a9-467c-87db-46cabbbe5ca1:3618:1875689390494464:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733730:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875689390495104:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733740:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1875689390495616:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733754:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1875689390496128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797468.733763:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390494976:0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.733772:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875689390495488:0@lo:400:kworker.0 00010000:00080000:1.0:1788797468.733830:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a2401699500 x1875689390496000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797468.733841:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a2401699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1875689390496000:0@lo:400:kworker.0 00000100:00100000:2.0:1788797468.738014:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875689390496128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797468.738034:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788797468.739125:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c41b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875689390495488:12345-0@lo:400:kworker.0 Request processed in 384us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797468.739140:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788797468.749527:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797468.749666:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390494848 00000100:00100000:1.0:1788797468.749696:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390494848 00000100:00100000:1.0:1788797468.750096:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788797468.750108:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390494848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797468.750197:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875689390494848:12345-0@lo:400:kworker.0 Request processed in 92us (25464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797468.750205:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797468.750300:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1875689390494848:0@lo:400:kworker.0 00000100:00080000:3.0:1788797468.750382:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788797468.980373:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788797469.173188:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797469.173197:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a22c2ffd000 from 13 10000000:01000000:2.0:1788797469.173203:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797469.173262:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.173273:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.173285:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.173330:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.173402:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.173458:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:1.0:1788797469.173669:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496512 00000100:00100000:1.0:1788797469.173678:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496512 00000100:00100000:1.0:1788797469.173738:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788797469.173747:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+20:22807:x1875689390496512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797469.173762:0:22804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.173782:0:22804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c12e4600/0x6418c0ce308ce76c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce765 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.173856:0:22804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c12e4600/0x6418c0ce308ce76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce765 expref: 21 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.173867:0:22804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c12e4600/0x6418c0ce308ce76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce765 expref: 21 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.173886:0:22804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4600, rc 0) 00000100:00100000:1.0:1788797469.173926:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.173942:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788797469.174491:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797469.174508:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce76c expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.174519:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce76c expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.174605:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.174652:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.174685:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:1.0:1788797469.174819:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496640 00000100:00100000:1.0:1788797469.174832:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496640 00000100:00100000:1.0:1788797469.174873:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788797469.174889:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797469.175201:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.175210:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788797469.175464:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.175496:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.175541:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.175610:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797469.177755:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496768 00000100:00100000:0.0:1788797469.177772:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496768 00000100:00100000:0.0:1788797469.179606:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788797469.179621:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.180035:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23eb32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 417us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.180043:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788797469.180177:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797469.184042:0:25865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788797469.184447:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788797469.184471:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797469.184483:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce76c expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.184495:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c0030000/0x6418c0ce308ce765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce76c expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797469.184506:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788797469.184508:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a23f246d000 from 13 10000000:01000000:0.0:1788797469.184511:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797469.184552:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.184560:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.184586:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797469.184611:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.184701:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797469.184753:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d8055000 going to sleep for 11 seconds 00000100:00100000:1.0:1788797469.184965:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390496896 00000100:00100000:1.0:1788797469.184973:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390496896 00000100:00100000:1.0:1788797469.185027:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788797469.185037:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+21:22807:x1875689390496896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797469.185051:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.185064:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c12e5e00/0x6418c0ce308ce77a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce773 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.185089:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c12e5e00/0x6418c0ce308ce77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce773 expref: 22 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.185099:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c12e5e00/0x6418c0ce308ce77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce773 expref: 22 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.185107:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5e00, rc 0) 00000100:00100000:1.0:1788797469.185154:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390496896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.185162:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788797469.185774:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390496896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797469.185815:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce77a expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.185924:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce77a expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.186004:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.186039:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.186073:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69600 going to sleep for 11 seconds 00000100:00100000:1.0:1788797469.186132:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497024 00000100:00100000:1.0:1788797469.186143:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497024 00000100:00100000:1.0:1788797469.186191:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788797469.186199:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390497024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797469.186320:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390497024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.186327:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788797469.186470:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.186501:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.186545:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797469.186569:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c42060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797469.186742:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497152 00000100:00100000:2.0:1788797469.186746:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497152 00000100:00100000:2.0:1788797469.186782:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788797469.186986:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390497152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.187191:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390497152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 401us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.187197:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788797469.193659:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23d89e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788797469.195673:0:25866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788797469.196188:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788797469.196224:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797469.196237:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce77a expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.196249:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a22c3901600/0x6418c0ce308ce773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce77a expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797469.196262:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797469.196265:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a22c2ff5000 from 13 10000000:01000000:2.0:1788797469.196268:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797469.196316:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.196325:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.196337:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.196380:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.196448:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.196490:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797469.196610:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497280 00000100:00100000:0.0:1788797469.196618:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497280 00000100:00100000:0.0:1788797469.196686:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788797469.196696:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+22:22807:x1875689390497280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797469.196715:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.196728:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a22c3901800/0x6418c0ce308ce788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce781 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.196753:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a22c3901800/0x6418c0ce308ce788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce781 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.196765:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a22c3901800/0x6418c0ce308ce788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce781 expref: 23 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.196772:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901800, rc 0) 00000100:00100000:0.0:1788797469.196850:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.196858:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788797469.200960:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797469.200993:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce788 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.201008:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce788 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.201102:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.201180:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.201228:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797469.203194:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497408 00000100:00100000:3.0:1788797469.203213:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497408 00000100:00100000:3.0:1788797469.203289:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788797469.203300:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.203505:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.203514:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788797469.205660:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.205729:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.205848:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797469.205917:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797469.206603:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497536 00000100:00100000:3.0:1788797469.206613:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497536 00000100:00100000:3.0:1788797469.206676:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788797469.206686:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.206862:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.206871:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788797469.209098:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23fa38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797469.211440:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.211507:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737408 00000100:00100000:0.0:1788797469.211526:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737408 00000100:00100000:0.0:1788797469.211581:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:0.0:1788797469.211588:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:18715:x1875689376737408:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797469.211604:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.211631:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce78f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca81f6 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211681:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211693:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211702:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211712:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211716:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211720:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211816:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900400/0x6418c0ce308ce7a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211832:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900400/0x6418c0ce308ce7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211839:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900400/0x6418c0ce308ce7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.211889:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797469.211893:0:22811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797469.211934:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900400/0x6418c0ce308ce7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211946:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211953:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211960:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211964:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900800 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.211967:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211973:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211981:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:0.0:1788797469.211984:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.211987:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.211991:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212003:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212019:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212024:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212029:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901a00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.212033:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212038:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212047:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a23f7604d00) 00010000:00010000:0.0:1788797469.212049:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.212052:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212058:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce79d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212092:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce78f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81f6 expref: 8 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212101:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900400/0x6418c0ce308ce7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81f6 expref: 7 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.212106:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a23f7604800) 00010000:00010000:0.0:1788797469.212108:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797469.212114:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900400, rc 0) 00000100:00100000:0.0:1788797469.212162:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18715:x1875689376737408:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 574us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.212168:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00080000:1.0:1788797469.212691:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788797469.215279:0:25867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788797469.216071:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788797469.216106:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797469.216117:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce788 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.216130:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a23c0031c00/0x6418c0ce308ce781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce788 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797469.216142:0:22807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788797469.216145:0:22807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a23fc5fe800 from 13 10000000:01000000:0.0:1788797469.216148:0:22807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797469.216198:0:22807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.216206:0:22807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.216219:0:22807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797469.216248:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.216319:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797469.216369:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d8055900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797469.216450:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497664 00000100:00100000:2.0:1788797469.216459:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497664 00000100:00100000:2.0:1788797469.216512:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788797469.216521:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+23:22807:x1875689390497664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797469.216535:0:22803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797469.216547:0:22803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c0030a00/0x6418c0ce308ce7b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6418c0ce308ce7ab expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.216587:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c0030a00/0x6418c0ce308ce7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6418c0ce308ce7ab expref: 24 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.216598:0:22803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c0030a00/0x6418c0ce308ce7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6418c0ce308ce7ab expref: 24 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.216607:0:22803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c0030a00, rc 0) 00000100:00100000:2.0:1788797469.216659:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390497664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.216666:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788797469.216976:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797469.216993:0:22807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce7b2 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.217016:0:22807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6418c0ce308ce7b2 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797469.217078:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.217108:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797469.217127:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d8055900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797469.217198:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497792 00000100:00100000:2.0:1788797469.217204:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497792 00000100:00100000:2.0:1788797469.217237:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788797469.217244:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390497792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.217355:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390497792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.217362:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788797469.217448:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c39dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797469.217479:0:22807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797469.217523:0:22807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797469.217552:0:22807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797469.218103:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390497920 00000100:00100000:3.0:1788797469.218110:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390497920 00000100:00100000:3.0:1788797469.218737:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788797469.218747:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390497920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.220183:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:22807:x1875689390497920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1433us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.220195:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788797469.224055:0:22807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42e4a701-62a9-467c-87db-46cabbbe5ca1:22807:1875689390497920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788797469.226090:0:25868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788797469.226275:0:22807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788797469.226307:0:22807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797469.226321:0:22807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce7b2 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.226334:0:22807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.133@tcp lock: ffff9a22c3900200/0x6418c0ce308ce7ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6418c0ce308ce7b2 expref: -99 pid: 22807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797469.242378:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.242448:0:22822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737536 00000100:00100000:3.0:1788797469.242460:0:22822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737536 00000100:00100000:3.0:1788797469.242574:0:22822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1788797469.242586:0:22822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18715:x1875689376737536:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788797469.242677:0:22822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18715:x1875689376737536:12345-192.168.202.33@tcp:900:lhsmtool_posix.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.242685:0:22822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1788797469.255672:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.255815:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737792 00000100:00100000:1.0:1788797469.255826:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737792 00000100:00100000:1.0:1788797469.255905:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:1.0:1788797469.255916:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18715:x1875689376737792:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797469.255937:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.255960:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca81fd expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.256280:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.256297:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257260:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257281:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257289:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257297:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257539:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4400/0x6418c0ce308ce7ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257548:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4400/0x6418c0ce308ce7ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257556:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4400/0x6418c0ce308ce7ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797469.257566:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788797469.257727:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257735:0:22812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257742:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257748:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4a00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.257760:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257768:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257780:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a23f7604800) 00010000:00010000:1.0:1788797469.257782:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.257837:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257845:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257869:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257885:0:22812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257891:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257896:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.257899:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257904:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257911:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a23d299ed00) 00010000:00010000:1.0:1788797469.257913:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.257924:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.257929:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.260298:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81fd expref: 10 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.260340:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4400/0x6418c0ce308ce7ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81fd expref: 9 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.260350:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a23d299e700) 00010000:00010000:1.0:1788797469.260353:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.260357:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4400, rc 0) 00000100:00100000:1.0:1788797469.260434:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18715:x1875689376737792:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 4519us (4772us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788797469.260443:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:0.0:1788797469.268981:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.269356:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376737920 00000100:00100000:1.0:1788797469.269367:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376737920 00000100:00100000:1.0:1788797469.269433:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1788797469.269444:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18715:x1875689376737920:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788797469.269552:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18715:x1875689376737920:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 110us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.269559:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1788797469.272130:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.272221:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738048 00000100:00100000:3.0:1788797469.272232:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738048 00000100:00100000:3.0:1788797469.272287:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:3.0:1788797469.272298:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c39dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18721:x1875689376738048:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1788797469.272318:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797469.272343:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df200/0x6418c0ce308ce7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8204 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272407:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272422:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272448:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272537:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272546:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272553:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272605:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272613:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272619:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272635:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797469.272640:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272648:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272659:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:3.0:1788797469.272662:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797469.272667:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272680:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272695:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272701:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272707:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272712:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021dfc00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797469.272715:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272721:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272730:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23f9faf300) 00010000:00010000:3.0:1788797469.272732:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797469.272736:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272741:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce7ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272774:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df200/0x6418c0ce308ce7dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8204 expref: 10 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272847:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:3.0:1788797469.272849:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797469.272854:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df200/0x6418c0ce308ce7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8204 expref: 10 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.272864:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021df200, rc 0) 00000100:00100000:3.0:1788797469.272928:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c39dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18721:x1875689376738048:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 632us (808us total) trans 0 rc 301/301 00000100:00100000:3.0:1788797469.272935:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:3.0:1788797469.277641:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.277713:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738176 00000100:00100000:1.0:1788797469.277723:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738176 00000100:00100000:1.0:1788797469.277833:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00100000:1.0:1788797469.277887:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18715:x1875689376738176:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788797469.278870:0:22811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 939us 00000100:00080000:3.0:1788797469.280063:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788797469.281181:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.282021:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738304 00000100:00100000:2.0:1788797469.282030:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738304 00000100:00100000:2.0:1788797469.282074:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:2.0:1788797469.282084:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18721:x1875689376738304:12345-192.168.202.33@tcp:700:lfs.0 00000100:00100000:2.0:1788797469.282285:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18721:x1875689376738304:12345-192.168.202.33@tcp:700:lfs.0 Request processed in 80us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.282295:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1788797469.285186:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.285443:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738560 00000100:00100000:1.0:1788797469.285453:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738560 00000100:00100000:1.0:1788797469.285514:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:1.0:1788797469.285526:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:18721:x1875689376738560:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:1.0:1788797469.285584:0:22812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797469.285612:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca817f expref: 9 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.285630:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:1.0:1788797469.285635:0:22812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797469.285696:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.285711:0:22812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 5 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.285720:0:22812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.285751:0:22812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 5 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.285764:0:22812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 5 pid: 24561 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797469.285809:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498048:192.168.202.33@tcp:104: 00000100:00100000:1.0:1788797469.285916:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797469.295700:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.296616:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738688 00000100:00100000:2.0:1788797469.296634:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738688 00010000:00010000:2.0:1788797469.296695:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 6 pid: 24561 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797469.296733:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:2.0:1788797469.296743:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2407:x1875689376738688:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797469.296758:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797469.296766:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 6 pid: 24561 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.296779:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 6 pid: 24561 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.296819:0:22797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:2.0:1788797469.296835:0:22797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.296846:0:22797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.296854:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.296882:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797469.296935:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2407:x1875689376738688:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 193us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.296942:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:0.0:1788797469.299559:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18715:x1875689376738176:12345-192.168.202.33@tcp:59:lhsmtool_posix.0 Request processed in 21675us (21926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.299574:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 27 00000100:00080000:3.0:1788797469.300272:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788797469.304662:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c0031400/0x6418c0ce308ce757 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca81ef expref: 5 pid: 24561 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797469.304685:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498048:192.168.202.33@tcp:104: 00010000:00010000:1.0:1788797469.304712:0:22812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.305080:0:22812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.305089:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.305116:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.305129:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.305139:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307527:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307546:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307557:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797469.307585:0:22812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de8f5033 reply state 00000000e201e5d7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307596:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307603:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797469.307606:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797469.307610:0:22812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788797469.307615:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788797469.307683:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307691:0:22812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307697:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307703:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5400 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.307707:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307714:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307725:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23f7604b00) 00010000:00010000:1.0:1788797469.307727:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.307730:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307745:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce7f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797469.307763:0:22812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de8f5033 reply state 00000000e201e5d7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307771:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.307777:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23d299ed00) 00010000:00010000:1.0:1788797469.307780:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797469.307782:0:22812:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788797469.308077:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+10:18721:x1875689376738560:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 22549us (22897us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788797469.308086:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:2.0:1788797469.389982:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.390165:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738816 00000100:00100000:1.0:1788797469.390177:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738816 00000100:00100000:1.0:1788797469.390250:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:1.0:1788797469.390261:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+10:18729:x1875689376738816:12345-192.168.202.33@tcp:101:lctl.0 00010000:00010000:1.0:1788797469.390289:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.390327:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca820b expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390399:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5c00/0x6418c0ce308ce80d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390414:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5c00/0x6418c0ce308ce80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390444:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5c00/0x6418c0ce308ce80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797469.390504:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788797469.390508:0:24561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797469.390553:0:24561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5c00/0x6418c0ce308ce80d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390583:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca820b expref: 12 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390605:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5c00/0x6418c0ce308ce80d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca820b expref: 11 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.390613:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:1.0:1788797469.390616:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797469.390632:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5c00, rc 0) 00000100:00100000:1.0:1788797469.391018:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+11:18729:x1875689376738816:12345-192.168.202.33@tcp:101:lctl.0 Request processed in 757us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.391026:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1788797469.403870:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.404418:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376738944 00000100:00100000:2.0:1788797469.404431:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376738944 00000100:00100000:2.0:1788797469.404529:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 162 00000100:00100000:2.0:1788797469.404540:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+11:18095:x1875689376738944:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797469.404562:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797469.404584:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a23c0031600/0x6418c0ce308ce814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8212 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.404631:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a23c0031600/0x6418c0ce308ce814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8212 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.404644:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a23c0031600/0x6418c0ce308ce814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8212 expref: 12 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797469.404654:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c0031600, rc 0) 00000100:00100000:2.0:1788797469.404724:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376738944:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 186us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.404731:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 162 00000100:00100000:2.0:1788797469.417559:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.417773:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739072 00000100:00100000:0.0:1788797469.417783:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739072 00000100:00100000:0.0:1788797469.417907:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:0.0:1788797469.417916:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+5:18730:x1875689376739072:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1788797469.417938:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.417965:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8219 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418034:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce822 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418049:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418061:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.418105:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797469.418109:0:22811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797469.418130:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce822 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418154:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8219 expref: 7 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418171:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901a00/0x6418c0ce308ce822 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8219 expref: 6 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.418181:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:0.0:1788797469.418183:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797469.418186:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901a00, rc 0) 00000100:00100000:0.0:1788797469.418257:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18730:x1875689376739072:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 342us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.418271:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:3.0:1788797469.425337:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.425848:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739200 00000100:00100000:2.0:1788797469.425860:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739200 00000100:00100000:2.0:1788797469.425930:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 163 00000100:00100000:2.0:1788797469.425941:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376739200:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797469.426094:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376739200:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 153us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.426102:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 163 00010000:00010000:2.0:1788797469.427172:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797469.431166:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.431357:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739328 00000100:00100000:0.0:1788797469.431368:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739328 00000100:00100000:0.0:1788797469.431431:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:0.0:1788797469.431443:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376739328:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.431619:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376739328:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 178us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.431627:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 164 00000100:00100000:0.0:1788797469.437234:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.437380:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739456 00000100:00100000:3.0:1788797469.437391:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739456 00000100:00100000:3.0:1788797469.437450:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:3.0:1788797469.437467:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+12:18095:x1875689376739456:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797469.437483:0:22805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797469.437504:0:22805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce829 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8220 expref: -99 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.437534:0:22805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8220 expref: 13 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.437545:0:22805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a24021df200/0x6418c0ce308ce829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8220 expref: 13 pid: 22805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.437571:0:22805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021df200, rc 0) 00000100:00100000:3.0:1788797469.437645:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18095:x1875689376739456:12345-192.168.202.33@tcp:101:ll_cfg_requeue.0 Request processed in 181us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.437652:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 165 00000100:00100000:3.0:1788797469.441277:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.441491:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739584 00000100:00100000:1.0:1788797469.441501:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739584 00000100:00100000:1.0:1788797469.441563:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:1.0:1788797469.441575:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+6:18730:x1875689376739584:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1788797469.441598:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.441634:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8227 expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441723:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441741:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441754:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441766:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441773:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.441780:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442174:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442185:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442193:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797469.442233:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788797469.442237:0:24561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797469.442258:0:24561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442285:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442292:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442299:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442306:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.442310:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442317:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442330:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:1.0:1788797469.442333:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.442337:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442343:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442358:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442365:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442370:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442382:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4800 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.442386:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442392:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442399:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23d299ed00) 00010000:00010000:1.0:1788797469.442401:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.442404:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442410:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce83e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442442:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8227 expref: 8 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.442998:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8227 expref: 7 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.443007:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797469.443010:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797469.443013:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5000, rc 0) 00000100:00100000:1.0:1788797469.443086:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+7:18730:x1875689376739584:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 1514us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.443094:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:2.0:1788797469.447069:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.447211:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739712 00000100:00100000:3.0:1788797469.447224:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739712 00000100:00100000:3.0:1788797469.447289:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:3.0:1788797469.447302:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18095:x1875689376739712:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797469.447537:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23d89c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18095:x1875689376739712:12345-192.168.202.33@tcp:501:ll_cfg_requeue.0 Request processed in 237us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.447546:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 166 00000100:00100000:1.0:1788797469.452559:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.452781:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.453631:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739840 00000100:00100000:2.0:1788797469.453644:0:22821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739840 00000100:00100000:2.0:1788797469.453722:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1788797469.453733:0:22821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62a16f93-c353-4076-bef0-cc464ba0d33d+5:18730:x1875689376739840:12345-192.168.202.33@tcp:900:lfs.0 00000100:00080000:1.0:1788797469.454001:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788797469.454347:0:22821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62a16f93-c353-4076-bef0-cc464ba0d33d+5:18730:x1875689376739840:12345-192.168.202.33@tcp:900:lfs.0 Request processed in 615us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797469.454357:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:0.0:1788797469.457143:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376739968 00000100:00100000:0.0:1788797469.457163:0:22803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376739968 00000100:00100000:0.0:1788797469.457247:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:0.0:1788797469.457257:0:22803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18095:x1875689376739968:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797469.457428:0:22803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:18095:x1875689376739968:12345-192.168.202.33@tcp:503:ll_cfg_requeue.0 Request processed in 171us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.457436:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 167 00000100:00100000:1.0:1788797469.460897:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.461085:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376740224 00000100:00100000:0.0:1788797469.461098:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376740224 00000100:00100000:0.0:1788797469.461173:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1788797469.461184:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+7:18730:x1875689376740224:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1788797469.461207:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.461229:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca822e expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.461338:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788797469.461479:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce84c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca822e expref: 9 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.461495:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:0.0:1788797469.461499:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797469.461504:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca822e expref: 9 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.461519:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900600, rc 0) 00000100:00100000:0.0:1788797469.461591:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+8:18730:x1875689376740224:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 407us (715us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788797469.461598:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1788797469.465919:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.466212:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376740480 00000100:00100000:3.0:1788797469.466222:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376740480 00000100:00100000:3.0:1788797469.466283:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:3.0:1788797469.466294:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+8:18730:x1875689376740480:12345-192.168.202.33@tcp:36:lfs.0 00010000:00010000:3.0:1788797469.466351:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797469.466377:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce845 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8227 expref: 8 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.466399:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:3.0:1788797469.466405:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797469.466431:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.466477:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.466489:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797469.466720:0:22810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051941fda reply state 0000000045948aff transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.466734:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.466740:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:3.0:1788797469.466743:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788797469.466746:0:22810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788797469.466753:0:22810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788797469.466887:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+9:18730:x1875689376740480:12345-192.168.202.33@tcp:36:lfs.0 Request processed in 594us (978us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788797469.466894:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:2.0:1788797469.469908:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.470450:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376740736 00000100:00100000:3.0:1788797469.470473:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376740736 00000100:00100000:3.0:1788797469.470541:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1788797469.470552:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+9:18730:x1875689376740736:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1788797469.471162:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+10:18730:x1875689376740736:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 608us (1260us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788797469.471171:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:2.0:1788797469.474301:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.474394:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376740992 00000100:00100000:0.0:1788797469.474407:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376740992 00000100:00100000:0.0:1788797469.474485:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:0.0:1788797469.474499:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+10:18730:x1875689376740992:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1788797469.474530:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.474554:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8235 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474780:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474937:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474949:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474980:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474988:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.474995:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.475116:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788797469.475202:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475210:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475216:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475221:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.475225:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475232:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475243:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:0.0:1788797469.475246:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.475251:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475267:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475283:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475289:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475295:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475300:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.475303:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475309:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475317:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23d299ed00) 00010000:00010000:0.0:1788797469.475320:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.475322:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475328:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce86f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475363:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce861 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8235 expref: 12 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475386:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:0.0:1788797469.475388:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797469.475392:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8235 expref: 12 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.475402:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900600, rc 0) 00000100:00100000:0.0:1788797469.475491:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+11:18730:x1875689376740992:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 996us (1207us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788797469.475500:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 34 00000100:00100000:1.0:1788797469.481706:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.481848:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376741120 00000100:00100000:3.0:1788797469.481858:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376741120 00000100:00100000:3.0:1788797469.481946:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:3.0:1788797469.481957:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+11:18730:x1875689376741120:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1788797469.481982:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797469.482003:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce87d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca823c expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482100:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482116:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482128:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797469.482154:0:22810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788797469.482158:0:22810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788797469.482180:0:22810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482211:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce87d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 13 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482232:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.482241:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:3.0:1788797469.482244:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797469.482248:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021de200, rc 0) 00000100:00100000:3.0:1788797469.482317:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+12:18730:x1875689376741120:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 362us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.482331:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 35 00000100:00100000:2.0:1788797469.487342:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.487440:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376741248 00000100:00100000:1.0:1788797469.487462:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376741248 00000100:00100000:1.0:1788797469.487531:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1788797469.487542:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+12:18730:x1875689376741248:12345-192.168.202.33@tcp:37:lfs.0 00000100:00100000:1.0:1788797469.494227:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+12:18730:x1875689376741248:12345-192.168.202.33@tcp:37:lfs.0 Request processed in 6674us (6885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.494241:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1788797469.503275:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.503359:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376741504 00000100:00100000:3.0:1788797469.503370:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376741504 00000100:00100000:3.0:1788797469.503430:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:3.0:1788797469.503440:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa79f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+12:18730:x1875689376741504:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1788797469.503694:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa79f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+13:18730:x1875689376741504:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 255us (430us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788797469.503702:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4 00000100:00100000:2.0:1788797469.576228:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.576336:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376741632 00000100:00100000:0.0:1788797469.576346:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376741632 00000100:00100000:0.0:1788797469.576411:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:0.0:1788797469.576423:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+11:18738:x1875689376741632:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1788797469.576445:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.576478:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce88b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8243 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576543:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576558:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576569:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576579:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576601:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576607:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576700:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce8a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576711:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce8a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576717:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce8a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.576751:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797469.576755:0:22811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797469.576835:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce8a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576849:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576864:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576879:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576885:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.576890:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576905:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576920:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:0.0:1788797469.576922:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.576928:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576934:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576951:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576957:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576963:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576969:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797469.576972:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576978:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.576985:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23d299ed00) 00010000:00010000:0.0:1788797469.576987:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797469.576990:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.577007:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce899 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.577037:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce88b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8243 expref: 13 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.577052:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901400/0x6418c0ce308ce8a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8243 expref: 12 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.577059:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:0.0:1788797469.577061:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788797469.577064:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901400, rc 0) 00000100:00100000:0.0:1788797469.577134:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+12:18738:x1875689376741632:12345-192.168.202.33@tcp:101:bash.0 Request processed in 712us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.577142:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 36 00000100:00100000:2.0:1788797469.582954:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.583197:0:22821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376741760 00000100:00100000:0.0:1788797469.583210:0:22821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376741760 00000100:00100000:0.0:1788797469.583282:0:22821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:0.0:1788797469.583295:0:22821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18738:x1875689376741760:12345-192.168.202.33@tcp:900:bash.0 00000100:00100000:0.0:1788797469.583392:0:22821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:18738:x1875689376741760:12345-192.168.202.33@tcp:900:bash.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.583401:0:22821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1788797469.604158:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.604254:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376742016 00000100:00100000:0.0:1788797469.604265:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376742016 00000100:00100000:0.0:1788797469.604336:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:0.0:1788797469.604348:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+12:18738:x1875689376742016:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1788797469.604391:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.604420:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8a7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca824a expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.604542:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.604558:0:22810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.604567:0:22810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.604603:0:22810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 12 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.604617:0:22810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 12 pid: 22810 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797469.604632:0:22810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22810:1875689390498176:192.168.202.33@tcp:104: 00000100:00100000:0.0:1788797469.604727:0:22810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23f2471f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797469.611377:0:22810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22810:1875689390498176:192.168.202.33@tcp:104: 00010000:00010000:0.0:1788797469.611418:0:22810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797469.613253:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.613467:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376742144 00000100:00100000:1.0:1788797469.613476:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376742144 00010000:00010000:1.0:1788797469.613524:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 13 pid: 22810 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797469.613569:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16 00000100:00100000:1.0:1788797469.613579:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+13:2404:x1875689376742144:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797469.613595:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797469.613603:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 13 pid: 22810 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613616:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 13 pid: 22810 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613666:0:22795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de200/0x6418c0ce308ce884 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca823c expref: 13 pid: 22810 timeout: 829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613685:0:22795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797469.613691:0:22795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613702:0:22795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613710:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.613940:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797469.614000:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62a16f93-c353-4076-bef0-cc464ba0d33d+12:2404:x1875689376742144:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 422us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797469.614008:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16 00010000:00010000:0.0:1788797469.616678:0:22810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.616697:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617135:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617150:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617160:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617948:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617962:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.617981:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797469.617995:0:22810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788797469.618023:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618030:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618037:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618042:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797469.618047:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618055:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618066:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797469.618069:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797469.618074:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618080:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce8ae lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788797469.618095:0:22810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb0bcb97 reply state 00000000b86ac885 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618345:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618351:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a23d299e600) 00010000:00010000:1.0:1788797469.618354:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797469.618357:0:22810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788797469.618401:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8a7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 15 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618417:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 14 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.618423:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797469.618425:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788797469.618427:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5600, rc 0) 00000100:00100000:1.0:1788797469.618754:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+15:18738:x1875689376742016:12345-192.168.202.33@tcp:101:bash.0 Request processed in 14408us (14605us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788797469.618763:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 37 00000100:00100000:3.0:1788797469.642176:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.642679:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376742272 00000100:00100000:0.0:1788797469.642689:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376742272 00000100:00100000:0.0:1788797469.642756:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:0.0:1788797469.642767:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+15:18738:x1875689376742272:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1788797469.642844:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.642869:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce8ca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8251 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.642953:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.642967:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.642979:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.643032:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788797469.643038:0:22811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797469.643058:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.643069:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.643097:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce8ca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8251 expref: 17 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.643128:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8251 expref: 16 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.643152:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797469.643155:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797469.643158:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900600, rc 0) 00000100:00100000:0.0:1788797469.643213:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+16:18738:x1875689376742272:12345-192.168.202.33@tcp:101:bash.0 Request processed in 448us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.643220:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 38 00000100:00100000:2.0:1788797469.650220:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.650379:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376742528 00000100:00100000:3.0:1788797469.650390:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376742528 00000100:00100000:3.0:1788797469.650512:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5 00000100:00100000:3.0:1788797469.650524:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+16:18738:x1875689376742528:12345-192.168.202.33@tcp:35:bash.0 00000100:00100000:3.0:1788797469.651077:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+17:18738:x1875689376742528:12345-192.168.202.33@tcp:35:bash.0 Request processed in 553us (862us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788797469.651085:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5 00000040:00080000:0.0:1788797469.686345:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797469.780905:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.781004:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376742784 00000100:00100000:1.0:1788797469.781015:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376742784 00000100:00100000:1.0:1788797469.781083:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:1.0:1788797469.781094:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+17:18748:x1875689376742784:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1788797469.781118:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797469.781140:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce8d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8258 expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797469.781253:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788797469.781374:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce8d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8258 expref: 19 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.781404:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:1.0:1788797469.781408:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797469.781414:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce8d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8258 expref: 19 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797469.781429:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4c00, rc 0) 00000100:00100000:1.0:1788797469.781490:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+18:18748:x1875689376742784:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 399us (595us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788797469.781497:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 39 00000100:00100000:0.0:1788797469.784918:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797469.785007:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376743040 00000100:00100000:1.0:1788797469.785018:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376743040 00000100:00100000:1.0:1788797469.785085:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:1.0:1788797469.785096:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+18:18748:x1875689376743040:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:1.0:1788797469.785494:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+19:18748:x1875689376743040:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 398us (586us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788797469.785502:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 6 00000100:00100000:2.0:1788797469.846415:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.846522:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376743296 00000100:00100000:0.0:1788797469.846532:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376743296 00000100:00100000:0.0:1788797469.846595:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:0.0:1788797469.846606:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+19:18751:x1875689376743296:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:0.0:1788797469.846632:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797469.846654:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce8e6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca825f expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.846761:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce8ed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.846980:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce8ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.846996:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce8ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797469.847009:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788797469.847474:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce8e6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca825f expref: 22 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.847508:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce8ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca825f expref: 21 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.847517:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797469.847520:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797469.847523:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900e00, rc 0) 00000100:00100000:0.0:1788797469.847596:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18751:x1875689376743296:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 991us (1190us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788797469.847604:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 40 00000100:00100000:2.0:1788797469.853773:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797469.854383:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797469.854460:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376743552 00000100:00100000:0.0:1788797469.854470:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376743552 00000100:00100000:0.0:1788797469.854545:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:0.0:1788797469.854556:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:2404:x1875689376743552:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797469.854572:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797469.854602:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce8ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca825f expref: 21 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797469.854624:0:22796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797469.854629:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797469.854698:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:2404:x1875689376743552:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797469.854706:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:3.0:1788797469.855625:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376743424 00000100:00100000:3.0:1788797469.855633:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376743424 00000100:00100000:3.0:1788797469.855711:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:3.0:1788797469.855720:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18751:x1875689376743424:12345-192.168.202.33@tcp:54:lfs.0 00010000:00010000:3.0:1788797469.855781:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856096:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856139:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856341:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856349:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856355:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856362:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797469.856367:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856374:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856386:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797469.856389:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797469.856394:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797469.856399:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce8fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797469.856482:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18751:x1875689376743424:12345-192.168.202.33@tcp:54:lfs.0 Request processed in 762us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797469.856489:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 41 00000100:00100000:2.0:1788797469.860545:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797469.860644:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376743808 00000100:00100000:3.0:1788797469.860654:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376743808 00000100:00100000:3.0:1788797469.871387:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 7 00000100:00100000:3.0:1788797469.871407:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18751:x1875689376743808:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1788797469.871622:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18751:x1875689376743808:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 224us (11085us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788797469.871630:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 7 00000040:00080000:1.0:1788797470.006763:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788797470.246347:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797470.246455:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744064 00000100:00100000:2.0:1788797470.246469:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744064 00000100:00100000:2.0:1788797470.246542:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:2.0:1788797470.246552:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18783:x1875689376744064:12345-192.168.202.33@tcp:101:cat.0 00010000:00010000:2.0:1788797470.246578:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797470.246600:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308ce902 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8266 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797470.246727:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308ce909 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797470.246756:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308ce909 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797470.246771:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308ce909 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797470.246784:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788797470.246959:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308ce902 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8266 expref: 24 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797470.246979:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308ce909 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8266 expref: 23 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797470.246987:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797470.246990:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797470.246995:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084b200, rc 0) 00000100:00100000:2.0:1788797470.247062:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+23:18783:x1875689376744064:12345-192.168.202.33@tcp:101:cat.0 Request processed in 511us (728us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788797470.247070:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 42 00000100:00100000:2.0:1788797470.260195:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797470.260244:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.260742:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744448 00000100:00100000:3.0:1788797470.260754:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744448 00000100:00100000:3.0:1788797470.260878:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:3.0:1788797470.260890:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+23:2406:x1875689376744448:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797470.260909:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797470.260936:0:22795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308ce909 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8266 expref: 23 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797470.260955:0:22795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797470.260960:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797470.261384:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+22:2406:x1875689376744448:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 495us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797470.261393:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 1 00000100:00100000:1.0:1788797470.262897:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744320 00000100:00100000:1.0:1788797470.262910:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744320 00000100:00100000:1.0:1788797470.262962:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:1.0:1788797470.262970:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+22:18783:x1875689376744320:12345-192.168.202.33@tcp:35:cat.0 00000100:00100000:1.0:1788797470.263282:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+23:18783:x1875689376744320:12345-192.168.202.33@tcp:35:cat.0 Request processed in 311us (3096us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788797470.263309:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 8 00000100:00100000:2.0:1788797470.373686:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.373936:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744704 00000100:00100000:1.0:1788797470.373945:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744704 00000100:00100000:1.0:1788797470.374107:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:1.0:1788797470.374118:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+23:18789:x1875689376744704:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:1.0:1788797470.374142:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797470.374162:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce917 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca826d expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.374280:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce91e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.374297:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce91e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.374310:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce91e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797470.374321:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788797470.374471:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce917 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca826d expref: 26 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.374492:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce91e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca826d expref: 25 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.374501:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.374504:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797470.374508:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5000, rc 0) 00000100:00100000:1.0:1788797470.374583:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18789:x1875689376744704:12345-192.168.202.33@tcp:101:dd.0 Request processed in 467us (906us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788797470.374591:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 43 00000100:00100000:3.0:1788797470.381178:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.381226:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.381381:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744832 00000100:00100000:1.0:1788797470.381392:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744832 00000100:00100000:1.0:1788797470.381461:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:1.0:1788797470.381471:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18789:x1875689376744832:12345-192.168.202.33@tcp:101:dd.0 00010000:00010000:1.0:1788797470.381495:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797470.381519:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce92c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8274 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381554:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381568:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381581:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381707:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce92c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 27 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381727:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 26 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.381735:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.381738:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788797470.381741:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4000, rc 0) 00000100:00100000:1.0:1788797470.381856:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+26:18789:x1875689376744832:12345-192.168.202.33@tcp:101:dd.0 Request processed in 386us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.381872:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 44 00000100:00100000:0.0:1788797470.383471:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376744960 00000100:00100000:0.0:1788797470.383483:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376744960 00000100:00100000:0.0:1788797470.383556:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:0.0:1788797470.383565:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+26:2404:x1875689376744960:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797470.383578:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797470.383609:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce91e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca826d expref: 26 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797470.383628:0:22797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797470.383632:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797470.383685:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:2404:x1875689376744960:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 121us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797470.383691:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 2 00000100:00100000:3.0:1788797470.392222:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.394353:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745216 00000100:00100000:1.0:1788797470.394379:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745216 00000100:00100000:1.0:1788797470.394463:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 45 00000100:00100000:1.0:1788797470.394474:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18789:x1875689376745216:12345-192.168.202.33@tcp:36:dd.0 00010000:00010000:1.0:1788797470.394528:0:24561:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797470.394558:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900600/0x6418c0ce308ce8d1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8251 expref: 25 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.394577:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.394582:0:24561:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797470.396097:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.396124:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.396147:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797470.396201:0:24561:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788797470.396225:0:24561:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034c6471c reply state 000000003306c284 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.396237:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.396244:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.396259:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797470.396263:0:24561:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797470.397172:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+27:18789:x1875689376745216:12345-192.168.202.33@tcp:36:dd.0 Request processed in 2695us (4955us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788797470.397183:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 45 00000020:00080000:1.0:1788797470.397190:0:24561:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788797470.451922:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797470.484262:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.484311:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.484349:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.484378:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797470.484424:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745728 00000100:00100000:2.0:1788797470.484433:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745728 00000100:00100000:2.0:1788797470.484486:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376746240 00000100:00100000:2.0:1788797470.484490:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376746240 00000100:00100000:2.0:1788797470.484515:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1788797470.484531:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797470.484531:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745728:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797470.484550:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.484562:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.484631:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745600 00000100:00100000:1.0:1788797470.484635:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745600 00000100:00100000:1.0:1788797470.484659:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:1.0:1788797470.484666:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376746240:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797470.484717:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797470.484724:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:2.0:1788797470.484740:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:2.0:1788797470.484747:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745600:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797470.484826:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745344 00000100:00100000:0.0:1788797470.484830:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745344 00000100:00100000:0.0:1788797470.484861:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:0.0:1788797470.484882:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2405:x1875689376745344:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797470.491144:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797470.491192:0:24319:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788797470.491202:0:24319:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788797470.491351:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745472 00000100:00100000:3.0:1788797470.491361:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745472 00000100:00100000:3.0:1788797470.495746:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745984 00000100:00100000:3.0:1788797470.495764:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745984 00000100:00100000:3.0:1788797470.495823:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376745856 00000100:00100000:3.0:1788797470.495827:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376745856 00000100:00100000:3.0:1788797470.495850:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:3.0:1788797470.495870:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745472:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:3.0:1788797470.495970:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (11717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797470.495978:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:1.0:1788797470.498053:0:24712:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788797470.498071:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376746112 00000100:00100000:1.0:1788797470.498079:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376746112 00000100:00100000:1.0:1788797470.498115:0:24712:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788797470.498126:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:1.0:1788797470.498134:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376746112:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797470.498184:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376746112:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 51us (7051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.498191:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00080000:1.0:1788797470.498214:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797470.498218:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797470.498230:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:1.0:1788797470.498237:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376745984:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797470.498259:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376745984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (13911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.498264:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:1.0:1788797470.498277:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:1.0:1788797470.498298:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+12:2405:x1875689376745856:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797470.498322:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+12:2405:x1875689376745856:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 25us (13759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.498328:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:1.0:1788797470.498347:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2405:x1875689376746240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 13682us (13969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.498353:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:2.0:1788797470.503644:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376745600:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 18882us (19077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797470.503661:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:1.0:1788797470.506563:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2405:x1875689376745344:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 21668us (22017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797470.506580:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 168 00000100:00100000:3.0:1788797470.522906:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.523216:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376746496 00000100:00100000:1.0:1788797470.523227:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376746496 00000100:00100000:1.0:1788797470.523287:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:1.0:1788797470.523297:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+27:18789:x1875689376746496:12345-192.168.202.33@tcp:35:dd.0 00000100:00100000:1.0:1788797470.523541:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+28:18789:x1875689376746496:12345-192.168.202.33@tcp:35:dd.0 Request processed in 245us (644us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788797470.523549:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 9 00000100:00100000:3.0:1788797470.833969:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.834369:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376746624 00000100:00100000:1.0:1788797470.834380:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376746624 00000100:00100000:1.0:1788797470.834457:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:1.0:1788797470.834468:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+28:18803:x1875689376746624:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:1.0:1788797470.834491:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797470.834514:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce941 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca827b expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834584:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834623:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834635:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834648:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834655:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834661:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834738:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834747:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.834754:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797470.836062:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788797470.836067:0:24561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797470.836111:0:24561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836127:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836148:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836154:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836160:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836166:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5000 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797470.836170:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836178:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836191:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797470.836193:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797470.836198:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836203:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce948 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836219:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836224:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836230:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836923:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4e00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797470.836927:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836934:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836944:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a23d299e600) 00010000:00010000:1.0:1788797470.836947:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797470.836950:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.836957:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce94f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.837014:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce941 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca827b expref: 30 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.837030:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca827b expref: 29 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.837036:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.837038:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788797470.837041:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4c00, rc 0) 00000100:00100000:0.0:1788797470.843649:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+29:18803:x1875689376746624:12345-192.168.202.33@tcp:101:stat.0 Request processed in 9171us (9681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797470.843663:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 46 00000100:00100000:2.0:1788797470.913931:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797470.914044:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376746880 00000100:00100000:1.0:1788797470.914054:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376746880 00000100:00100000:1.0:1788797470.914124:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 47 00000100:00100000:1.0:1788797470.914134:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+29:18809:x1875689376746880:12345-192.168.202.33@tcp:36:truncate.0 00010000:00010000:1.0:1788797470.914219:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797470.914258:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce956 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca827b expref: 29 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.914280:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.914284:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788797470.914456:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.914470:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.914479:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788797470.914521:0:22811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1788797470.914542:0:22811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000134af855 reply state 00000000b0160656 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.914553:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797470.914559:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797470.914561:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788797470.914564:0:22811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797470.914691:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+31:18809:x1875689376746880:12345-192.168.202.33@tcp:36:truncate.0 Request processed in 558us (769us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788797470.914699:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 47 00000020:00080000:1.0:1788797470.914704:0:22811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788797471.066156:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797471.066278:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376747008 00000100:00100000:0.0:1788797471.066288:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376747008 00000100:00080000:1.0:1788797471.066348:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797471.066364:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1788797471.066375:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+31:18823:x1875689376747008:12345-192.168.202.33@tcp:101:stat.0 00010000:00010000:0.0:1788797471.066400:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797471.066420:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce964 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8282 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066498:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066513:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066525:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066537:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066545:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066551:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066624:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066633:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066640:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797471.066681:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788797471.066684:0:22812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797471.066703:0:22812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066730:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066736:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066740:0:22812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066745:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066749:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900e00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797471.066751:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066762:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066770:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:0.0:1788797471.066772:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797471.066776:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066779:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce96b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066814:0:22812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066818:0:22812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066828:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066833:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3901200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797471.066836:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066843:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066851:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a23d299e600) 00010000:00010000:0.0:1788797471.066853:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797471.066865:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066872:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce972 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066900:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce964 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 33 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066913:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 32 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.066920:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797471.066922:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797471.066925:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901c00, rc 0) 00000100:00100000:0.0:1788797471.066984:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+32:18823:x1875689376747008:12345-192.168.202.33@tcp:101:stat.0 Request processed in 612us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797471.067000:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 48 00000100:00100000:0.0:1788797471.214939:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797471.215087:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376747264 00000100:00100000:1.0:1788797471.215096:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376747264 00000100:00100000:1.0:1788797471.215148:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:1.0:1788797471.215158:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+32:18833:x1875689376747264:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:1.0:1788797471.215181:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797471.215204:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8289 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797471.215312:0:22811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788797471.215417:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce980 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8289 expref: 34 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.215432:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:1.0:1788797471.215434:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797471.215441:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8289 expref: 34 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.215458:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4e00, rc 0) 00000100:00100000:1.0:1788797471.215530:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+33:18833:x1875689376747264:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 373us (601us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1788797471.215538:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 49 00000100:00100000:1.0:1788797471.224390:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797471.224503:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376747520 00000100:00100000:0.0:1788797471.224515:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376747520 00000100:00100000:0.0:1788797471.224577:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:0.0:1788797471.224588:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa79e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+33:18833:x1875689376747520:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:0.0:1788797471.224932:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa79e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+34:18833:x1875689376747520:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 345us (552us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788797471.224941:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 10 00000100:00100000:2.0:1788797471.283134:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797471.283157:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390498304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788797471.283226:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797471.283703:0:24322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390498304 00000100:00100000:3.0:1788797471.283716:0:24322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390498304 00000100:00100000:3.0:1788797471.283812:0:24322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788797471.283945:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797471.283999:0:24322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390498304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797471.284032:0:24322:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797471.284093:0:24322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390498304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 272us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797471.284099:0:24322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797471.284206:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390498304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797471.342513:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797471.342672:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376747776 00000100:00100000:0.0:1788797471.342682:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376747776 00000100:00100000:0.0:1788797471.342743:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:0.0:1788797471.342754:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+34:18839:x1875689376747776:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:0.0:1788797471.342779:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797471.342882:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce98e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8290 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343015:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343031:0:22812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343039:0:22812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 35 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343061:0:22812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343095:0:22812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 35 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343108:0:22812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 35 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797471.343122:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498432:192.168.202.33@tcp:104: 00010000:00010000:0.0:1788797471.343206:0:22812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.343216:0:22812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797471.343226:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498560:192.168.202.33@tcp:104: 00000100:00100000:0.0:1788797471.343249:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c6b72900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797471.346744:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797471.346944:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f908b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498432:192.168.202.33@tcp:104: 00000100:00100000:0.0:1788797471.346955:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498560:192.168.202.33@tcp:104: 00010000:00010000:0.0:1788797471.346982:0:22812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797471.347056:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797471.347225:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376747904 00000100:00100000:0.0:1788797471.347232:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376747904 00010000:00010000:0.0:1788797471.347282:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 36 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797471.347314:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748032 00000100:00100000:0.0:1788797471.347317:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748032 00010000:00010000:0.0:1788797471.347328:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 37 pid: 22810 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797471.347342:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1788797471.347350:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c7500050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:2404:x1875689376747904:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797471.347365:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797471.347371:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 37 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347382:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 37 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347405:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308ce979 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8282 expref: 37 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347421:0:22797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797471.347425:0:22797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347447:0:22797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347453:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797471.347511:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c7500050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+36:2404:x1875689376747904:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 161us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797471.347523:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17 00000100:00100000:0.0:1788797471.347563:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18 00000100:00100000:0.0:1788797471.347569:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+35:2404:x1875689376748032:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797471.347576:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797471.347581:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347590:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347603:0:22797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce8bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca824a expref: 35 pid: 22810 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347613:0:22797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797471.347616:0:22797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347624:0:22797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347632:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347652:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797471.347671:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+34:2404:x1875689376748032:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 101us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797471.347678:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18 00010000:00010000:0.0:1788797471.347705:0:22812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.347711:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797471.347728:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788797471.348676:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900800/0x6418c0ce308ce98e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 35 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.348697:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 34 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797471.348704:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797471.348707:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788797471.348710:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901200, rc 0) 00000100:00100000:0.0:1788797471.348894:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+34:18839:x1875689376747776:12345-192.168.202.33@tcp:101:bash.0 Request processed in 6141us (6390us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788797471.348901:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 50 00000100:00100000:1.0:1788797471.357063:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797471.357158:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748288 00000100:00100000:3.0:1788797471.357168:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748288 00000100:00100000:3.0:1788797471.357254:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 51 00000100:00100000:3.0:1788797471.357264:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+34:18839:x1875689376748288:12345-192.168.202.33@tcp:36:bash.0 00010000:00010000:3.0:1788797471.357497:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.357514:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.357526:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797471.357568:0:22810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1788797471.357588:0:22810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003790107c reply state 000000003595e890 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.357599:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.357725:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797471.357728:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788797471.357732:0:22810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797471.357851:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18839:x1875689376748288:12345-192.168.202.33@tcp:36:bash.0 Request processed in 588us (794us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1788797471.364060:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 51 00000020:00080000:3.0:1788797471.364071:0:22810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788797471.364221:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797471.364934:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748416 00000100:00100000:1.0:1788797471.364945:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748416 00000100:00100000:1.0:1788797471.365017:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:1.0:1788797471.365026:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18839:x1875689376748416:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1788797471.365048:0:22811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797471.365068:0:22811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca8297 expref: -99 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.365127:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8297 expref: 38 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.365142:0:22811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8297 expref: 38 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.365159:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797471.365162:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797471.365167:0:22811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e5600, rc 0) 00000100:00100000:1.0:1788797471.365221:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18839:x1875689376748416:12345-192.168.202.33@tcp:101:bash.0 Request processed in 197us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797471.365228:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 52 00000100:00100000:2.0:1788797471.372285:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797471.372370:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748544 00000100:00100000:3.0:1788797471.372381:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748544 00000100:00100000:3.0:1788797471.372451:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1788797471.372473:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18839:x1875689376748544:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:3.0:1788797471.372494:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797471.372515:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dee00/0x6418c0ce308ce9b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca829e expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.372620:0:22812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.372635:0:22812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 39 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.372645:0:22812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.372687:0:22812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 39 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.372700:0:22812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 39 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797471.372714:0:22812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2344000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498688:192.168.202.33@tcp:104: 00000100:00100000:3.0:1788797471.372823:0:22812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a22c4206c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797471.376409:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797471.376458:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748672 00000100:00100000:3.0:1788797471.376467:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748672 00010000:00010000:3.0:1788797471.376504:0:22797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 40 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797471.376541:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 19 00000100:00100000:3.0:1788797471.376565:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:2405:x1875689376748672:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797471.376579:0:22797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797471.376588:0:22797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 40 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.376615:0:22797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 40 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.376642:0:22797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797471.376647:0:22797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.376656:0:22797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.376664:0:22797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797471.376684:0:22797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797471.376732:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:2405:x1875689376748672:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 170us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797471.376739:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 19 00010000:00010000:2.0:1788797471.376978:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901200/0x6418c0ce308ce995 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8290 expref: 39 pid: 22812 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797471.376996:0:22812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2344000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22812:1875689390498688:192.168.202.33@tcp:104: 00010000:00010000:2.0:1788797471.377019:0:22812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797471.377028:0:22812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797471.377047:0:22812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797471.377106:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788797471.377111:0:22812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788797471.377135:0:22812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797471.377169:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dee00/0x6418c0ce308ce9b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca829e expref: 39 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797471.377185:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca829e expref: 38 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797471.377194:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797471.377197:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797471.377200:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021df400, rc 0) 00000100:00100000:2.0:1788797471.377241:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18839:x1875689376748544:12345-192.168.202.33@tcp:101:bash.0 Request processed in 4771us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797471.377248:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 53 00000100:00100000:3.0:1788797471.381520:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797471.381653:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376748928 00000100:00100000:1.0:1788797471.381664:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376748928 00000100:00100000:1.0:1788797471.381732:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:1.0:1788797471.381742:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18839:x1875689376748928:12345-192.168.202.33@tcp:103:bash.0 00010000:00010000:1.0:1788797471.381761:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788797471.381937:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8297 expref: 38 pid: 22811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.381968:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df400/0x6418c0ce308ce9b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca829e expref: 37 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.381996:0:22796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797471.382001:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797471.382131:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+36:18839:x1875689376748928:12345-192.168.202.33@tcp:103:bash.0 Request processed in 390us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797471.382139:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3 00000100:00100000:3.0:1788797471.384417:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797471.384565:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749056 00000100:00100000:1.0:1788797471.384575:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749056 00000100:00100000:1.0:1788797471.384732:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:1.0:1788797471.384744:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+36:18839:x1875689376749056:12345-192.168.202.33@tcp:58:bash.0 00010000:00010000:1.0:1788797471.384914:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.384933:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.384945:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797471.385952:0:22810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797471.385985:0:22810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788797471.386160:0:22810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788797471.386263:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+36:18839:x1875689376749056:12345-192.168.202.33@tcp:58:bash.0 Request processed in 1518us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797471.386272:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 54 00000100:00100000:3.0:1788797471.388706:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797471.389125:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749184 00000100:00100000:2.0:1788797471.389136:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749184 00000100:00100000:1.0:1788797471.389227:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 55 00000100:00100000:1.0:1788797471.389240:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+36:18839:x1875689376749184:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1788797471.389263:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797471.389296:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82a5 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389352:0:22810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389363:0:22810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 37 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389381:0:22810:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389393:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 37 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389406:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797471.389409:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788797471.389413:0:22810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 37 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797471.389420:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a23c12e4c00, rc 0) 00000100:00100000:1.0:1788797471.389560:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18839:x1875689376749184:12345-192.168.202.33@tcp:101:bash.0 Request processed in 323us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797471.389567:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 55 00010000:00010000:0.0:1788797471.475114:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797472.051257:0:22846:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788797472.051274:0:22846:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797472.051303:0:22846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788797472.051312:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788797472.051460:0:22846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22846:1875689390498816:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788797472.051568:0:22846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788797472.063834:0:22846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22846:1875689390498816:192.168.202.33@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788797472.068204:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.068931:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749312 00000100:00100000:0.0:1788797472.068943:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749312 00000100:00100000:0.0:1788797472.069011:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:0.0:1788797472.069022:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18840:x1875689376749312:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788797472.069055:0:24561:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788797472.069183:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18840:x1875689376749312:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 163us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797472.069190:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 56 00000100:00100000:3.0:1788797472.074778:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.074901:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749440 00000100:00100000:1.0:1788797472.074911:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749440 00000100:00100000:1.0:1788797472.074982:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:1.0:1788797472.074992:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18840:x1875689376749440:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788797472.075061:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075076:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075087:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075130:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075137:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075144:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075167:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075176:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075182:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797472.075244:0:22810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788797472.075249:0:22810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797472.075261:0:22810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075272:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075279:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075285:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075291:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.075295:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075303:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075315:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a23d299e700) 00010000:00010000:1.0:1788797472.075318:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.075323:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075328:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5600/0x6418c0ce308ce9cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075341:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075430:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075436:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075440:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5000 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.075443:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075449:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075456:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a23d299ee00) 00010000:00010000:1.0:1788797472.075458:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.075461:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075466:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5000/0x6418c0ce308ce9d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075482:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075487:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075491:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075495:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.075505:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075510:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075517:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797472.075519:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.075521:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.075526:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514600/0x6418c0ce308ce9db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.077139:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18840:x1875689376749440:12345-192.168.202.33@tcp:34:lhsmtool_posix.0 Request processed in 2138us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.077154:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 57 00000100:00100000:3.0:1788797472.090658:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.091865:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749696 00000100:00100000:0.0:1788797472.091879:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749696 00000100:00100000:0.0:1788797472.091950:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1788797472.091961:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+37:18840:x1875689376749696:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797472.092095:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797472.092120:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82ac expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092237:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092254:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092267:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797472.092280:0:24561:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788797472.092366:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092374:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092381:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092386:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a22c3900c00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:0.0:1788797472.092391:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092399:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092425:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:0.0:1788797472.092428:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797472.092434:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092440:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092485:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9e2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82ac expref: 39 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092495:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a23d299e700) 00010000:00010000:0.0:1788797472.092498:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797472.092501:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82ac expref: 39 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.092511:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900e00, rc 0) 00000100:00100000:0.0:1788797472.093234:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18840:x1875689376749696:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 1267us (2578us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1788797472.093244:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 58 00000100:00100000:0.0:1788797472.113174:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.113529:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376749824 00000100:00100000:1.0:1788797472.113540:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376749824 00000100:00100000:1.0:1788797472.113613:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:1.0:1788797472.113623:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18840:x1875689376749824:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788797472.113664:0:22811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788797472.113831:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18840:x1875689376749824:12345-192.168.202.33@tcp:53:lhsmtool_posix.0 Request processed in 208us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.113838:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 59 00000100:00100000:2.0:1788797472.118271:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.118888:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750080 00000100:00100000:3.0:1788797472.118913:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750080 00000100:00100000:0.0:1788797472.119070:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:0.0:1788797472.119083:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+38:18840:x1875689376750080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797472.119107:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797472.119130:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9f7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82b3 expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788797472.119547:0:24561:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1788797472.119554:0:24561:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1788797472.119575:0:24561:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788797472.119744:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9fe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.119759:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.119769:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.119882:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308ce9f7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82b3 expref: 41 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.119901:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82b3 expref: 40 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.119910:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604d00) 00010000:00010000:0.0:1788797472.119913:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797472.119916:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900e00, rc 0) 00000100:00100000:0.0:1788797472.119987:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:18840:x1875689376750080:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 907us (1726us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788797472.119994:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 60 00000100:00100000:0.0:1788797472.131408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797472.131590:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750336 00000100:00100000:2.0:1788797472.131614:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750336 00000100:00100000:2.0:1788797472.131677:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:2.0:1788797472.131687:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:18840:x1875689376750336:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788797472.131982:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797472.132023:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900e00/0x6418c0ce308ce9fe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82b3 expref: 40 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132041:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604d00) 00010000:00010000:2.0:1788797472.132052:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797472.132076:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132089:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132099:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132115:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132122:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132129:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132179:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132188:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132194:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132200:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.132212:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132220:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132229:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:2.0:1788797472.132231:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797472.132235:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132241:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b600/0x6418c0ce308cea0c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132251:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132257:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132263:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132268:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084a400 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.132271:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132277:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132283:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x1aadf82e (ffff9a22c1f6d400) 00010000:00010000:2.0:1788797472.132285:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797472.132295:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.132300:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084a400/0x6418c0ce308cea13 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1aadf82e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.132389:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+39:18840:x1875689376750336:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 703us (990us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797472.132398:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 61 00000100:00100000:3.0:1788797472.135298:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.135395:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750464 00000100:00100000:0.0:1788797472.135405:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750464 00000100:00100000:0.0:1788797472.135500:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:0.0:1788797472.135519:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+39:18840:x1875689376750464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797472.135554:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797472.135604:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea1a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82ba expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.135673:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308cea21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.135706:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308cea21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.135730:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308cea21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.136024:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea1a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82ba expref: 41 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.136045:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3901c00/0x6418c0ce308cea21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82ba expref: 40 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.136053:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:0.0:1788797472.136056:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797472.136060:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3901c00, rc 0) 00000100:00100000:0.0:1788797472.137069:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:18840:x1875689376750464:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 951us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797472.137079:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 62 00000100:00100000:3.0:1788797472.145321:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.148550:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750720 00000100:00100000:1.0:1788797472.148566:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750720 00000100:00100000:1.0:1788797472.148962:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:1.0:1788797472.149096:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+40:18840:x1875689376750720:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797472.149214:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.149236:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.149249:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797472.149780:0:22810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788797472.150117:0:22810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 731970328185ns, next at 732970325104ns, rc = 0 00000004:00010000:1.0:1788797472.150171:0:22810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004e7d764 reply state 0000000093631fb2 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.150186:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.150193:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:1.0:1788797472.150196:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788797472.150200:0:22810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788797472.150367:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+42:18840:x1875689376750720:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1393us (5055us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788797472.150375:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 63 00000100:00100000:3.0:1788797472.159024:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.159104:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750848 00000100:00100000:0.0:1788797472.159116:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750848 00000100:00100000:0.0:1788797472.159202:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:0.0:1788797472.159213:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+42:18840:x1875689376750848:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797472.159243:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797472.159270:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82c1 expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.159331:0:22812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 43 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.159346:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 43 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797472.159364:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:0.0:1788797472.159367:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797472.159371:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a22c3900c00, rc 0) 00000100:00100000:0.0:1788797472.166910:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+43:18840:x1875689376750848:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 7686us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797472.166924:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 64 00000100:00100000:3.0:1788797472.170160:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.170526:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376750976 00000100:00100000:1.0:1788797472.170536:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376750976 00000100:00100000:1.0:1788797472.170682:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:1.0:1788797472.170693:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2405:x1875689376750976:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788797472.171053:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797472.173166:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2405:x1875689376750976:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 2466us (3008us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788797472.173197:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:2.0:1788797472.178891:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.179595:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376751232 00000100:00100000:1.0:1788797472.179606:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376751232 00000100:00100000:1.0:1788797472.179727:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:1.0:1788797472.179739:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+43:18840:x1875689376751232:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797472.180023:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+44:18840:x1875689376751232:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 287us (1140us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788797472.180031:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 11 00000100:00100000:2.0:1788797472.184931:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.185241:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376751488 00000100:00100000:3.0:1788797472.185252:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376751488 00000100:00100000:3.0:1788797472.185351:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:3.0:1788797472.185363:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+44:18840:x1875689376751488:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788797472.185605:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+44:18840:x1875689376751488:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 244us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797472.185612:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 65 00000100:00100000:0.0:1788797472.195958:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.200833:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376751616 00000100:00100000:1.0:1788797472.200860:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376751616 00000100:00100000:1.0:1788797472.201165:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:1.0:1788797472.201176:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+44:18840:x1875689376751616:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797472.201199:0:24561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797472.201222:0:24561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea36 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82c8 expref: -99 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201296:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201311:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201325:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797472.201374:0:24561:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797472.201394:0:24561:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201439:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea36 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c8 expref: 46 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201460:0:24561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c8 expref: 45 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.201468:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:1.0:1788797472.201471:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788797472.203708:0:24561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401515c00, rc 0) 00000100:00100000:1.0:1788797472.203816:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+45:18840:x1875689376751616:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 2638us (7863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.203825:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 66 00000100:00100000:2.0:1788797472.213173:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.213613:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376751744 00000100:00100000:1.0:1788797472.213627:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376751744 00000100:00100000:1.0:1788797472.213736:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:1.0:1788797472.213748:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+6:2404:x1875689376751744:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788797472.213770:0:24319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797472.213830:0:24319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82cf expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797472.213866:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee220, blocks: 0x0 00010000:00010000:1.0:1788797472.213886:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1788797472.213890:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797472.213899:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 7 pid: 24319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.213936:0:24319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 7 pid: 24319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.213950:0:24319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514200, rc 0) 00000100:00100000:1.0:1788797472.214012:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2404:x1875689376751744:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 267us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.214018:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:3.0:1788797472.222908:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.223203:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752000 00000100:00100000:1.0:1788797472.223214:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752000 00000100:00100000:1.0:1788797472.223281:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:1.0:1788797472.223292:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+45:18840:x1875689376752000:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788797472.223421:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+45:18840:x1875689376752000:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 130us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.223437:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 67 00000100:00100000:0.0:1788797472.232513:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.232752:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752128 00000100:00100000:3.0:1788797472.232766:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752128 00000100:00100000:3.0:1788797472.232893:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 68 00000100:00100000:3.0:1788797472.232904:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+45:18840:x1875689376752128:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788797472.236081:0:22790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788797472.236095:0:22790:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788797472.236156:0:22790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788797472.236211:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236223:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236231:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236238:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021dfc00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.236242:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236249:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236281:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:2.0:1788797472.236284:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788797472.236290:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.236296:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dfc00/0x6418c0ce308ce85a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.236467:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390498944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788797472.236550:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797472.236671:0:25871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390498944 00000100:00100000:3.0:1788797472.236679:0:25871:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390498944 00000100:00100000:3.0:1788797472.236726:0:25871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788797472.236737:0:25871:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390498944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788797472.236908:0:25871:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788797472.236912:0:25871:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788797472.236914:0:25871:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788797472.236917:0:25871:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788797472 -> 1788797472 00002000:00010000:3.0:1788797472.236919:0:25871:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1788797472.237003:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237012:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237019:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237025:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237039:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237054:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237065:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a23d299ed00) 00010000:00010000:1.0:1788797472.237068:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237071:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237077:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5200/0x6418c0ce308ce7f8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237095:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237101:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237106:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237118:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4a00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237120:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237126:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237134:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:1.0:1788797472.237136:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237139:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237151:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4a00/0x6418c0ce308ce7ff lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237167:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237173:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237179:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237183:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237186:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237192:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237200:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a23d299e600) 00010000:00010000:1.0:1788797472.237202:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237205:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237211:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4200/0x6418c0ce308ce8b5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237224:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237231:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237243:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237270:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e5400 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237273:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237280:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237288:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797472.237290:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237293:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237299:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e5400/0x6418c0ce308ce93a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237312:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237317:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237322:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237326:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4800 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237328:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237345:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237352:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797472.237354:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237357:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237363:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4800/0x6418c0ce308ce95d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237375:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237380:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237386:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237390:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237392:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237397:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237403:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:1.0:1788797472.237405:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797472.237407:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237424:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ce9a3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237435:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237442:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237448:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237453:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401515800 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:1.0:1788797472.237455:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237459:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237466:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:1.0:1788797472.237467:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788797472.237470:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.237488:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515800/0x6418c0ce308cea28 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797472.238713:0:25871:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1875689390498944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1971us (2169us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788797472.238737:0:25871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788797472.238926:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+14:18840:x1875689376752128:12345-192.168.202.33@tcp:44:lhsmtool_posix.0 Request processed in 6022us (6423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797472.238934:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 68 00000004:00080000:2.0:1788797472.240549:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a23f9088a80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788797472.240565:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23f9088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390498944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788797472.250620:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.251361:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752256 00000100:00100000:1.0:1788797472.251372:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752256 00000100:00100000:0.0:1788797472.256236:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:0.0:1788797472.256252:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2404:x1875689376752256:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788797472.256411:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2404:x1875689376752256:12345-192.168.202.33@tcp:16:lhsmtool_posix.0 Request processed in 162us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797472.256419:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 28 00000100:00100000:0.0:1788797472.265397:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.274338:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752512 00000100:00100000:1.0:1788797472.274358:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752512 00000100:00100000:1.0:1788797472.274455:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1788797472.274466:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f908a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+14:18840:x1875689376752512:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788797472.274523:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797472.274561:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401515c00/0x6418c0ce308cea3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c8 expref: 14 pid: 24561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.274582:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:1.0:1788797472.274586:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797472.275189:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084be00/0x6418c0ce308cea4b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.275209:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084be00/0x6418c0ce308cea4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.275222:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084be00/0x6418c0ce308cea4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797472.275370:0:22810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004759a789 reply state 00000000c2f46427 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084be00/0x6418c0ce308cea4b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.275383:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084be00/0x6418c0ce308cea4b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.275389:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:2.0:1788797472.275401:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788797472.275404:0:22810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788797472.275528:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f908a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+15:18840:x1875689376752512:12345-192.168.202.33@tcp:36:lhsmtool_posix.0 Request processed in 1063us (10141us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788797472.275545:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 69 00000100:00100000:1.0:1788797472.280344:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.280483:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752640 00000100:00100000:3.0:1788797472.280493:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752640 00000100:00100000:3.0:1788797472.280562:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:3.0:1788797472.280573:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18840:x1875689376752640:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797472.280885:0:24319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797472.281547:0:24319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82d6 expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.282045:0:24319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.282060:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797472.282064:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797472.282071:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.282115:0:24319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.282134:0:24319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.282226:0:24319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24319:1875689390499072:192.168.202.33@tcp:104: 00000100:00100000:2.0:1788797472.282434:0:24319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797472.294679:0:24319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24319:1875689390499072:192.168.202.33@tcp:104: 00010000:00010000:2.0:1788797472.294719:0:24319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.294759:0:24319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084b400, rc 0) 00000100:00100000:2.0:1788797472.294867:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:18840:x1875689376752640:12345-192.168.202.33@tcp:101:lhsmtool_posix.0 Request processed in 14295us (14532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797472.294876:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 29 00000100:00100000:0.0:1788797472.299397:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.299925:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752768 00000100:00100000:1.0:1788797472.299935:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752768 00010000:00010000:1.0:1788797472.299992:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.300037:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:1.0:1788797472.300047:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:2404:x1875689376752768:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797472.300064:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797472.300087:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.300101:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.300124:0:22795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bdae475/0x6418c0ce308cea44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82cf expref: 8 pid: 24319 timeout: 832 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.300175:0:22795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797472.300179:0:22795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797472.300186:0:22795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 7 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.300195:0:22795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 7 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.300237:0:22795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 7 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.300251:0:22795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c42b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22795:1875689390499200:192.168.202.33@tcp:105: 00000100:00100000:1.0:1788797472.300348:0:22795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23d186e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797472.308931:0:22795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c42b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22795:1875689390499200:192.168.202.33@tcp:105: 00010000:00010000:3.0:1788797472.308973:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797472.309042:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2404:x1875689376752768:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 8995us (9654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797472.309054:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 20 00000100:00100000:3.0:1788797472.310699:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.310815:0:24320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376752896 00000100:00100000:1.0:1788797472.310825:0:24320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376752896 00000100:00100000:1.0:1788797472.310887:0:24320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:1.0:1788797472.310896:0:24320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c1ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2404:x1875689376752896:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788797472.311088:0:24320:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788797472.311092:0:24320:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788797471 00002000:00010000:1.0:1788797472.311094:0:24320:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788797469 00002000:00010000:1.0:1788797472.311096:0:24320:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788797472 -> 1788797471 00002000:00010000:1.0:1788797472.311099:0:24320:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788797472.311163:0:24320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c1ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:2404:x1875689376752896:12345-192.168.202.33@tcp:2:lhsmtool_posix.0 Request processed in 268us (472us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788797472.311179:0:24320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 30 00000100:00100000:1.0:1788797472.316745:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797472.316856:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753024 00000100:00100000:2.0:1788797472.316866:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753024 00000100:00100000:2.0:1788797472.316928:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:2.0:1788797472.316937:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:2405:x1875689376753024:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788797472.317020:0:24321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.317040:0:24321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.317048:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797472.317052:0:24321:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797472.317056:0:24321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.317090:0:24321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.317105:0:24321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 8 pid: 24319 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.317130:0:24321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24321:1875689390499328:192.168.202.33@tcp:104: 00000100:00100000:2.0:1788797472.317226:0:24321:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797472.320660:0:24321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24321:1875689390499328:192.168.202.33@tcp:104: 00010000:00010000:2.0:1788797472.320691:0:24321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.321938:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.330507:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753152 00000100:00100000:0.0:1788797472.330523:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753152 00010000:00010000:2.0:1788797472.330823:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 9 pid: 24319 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.331078:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 21 00000100:00100000:2.0:1788797472.331091:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:2404:x1875689376753152:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797472.331107:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797472.331133:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 9 pid: 24319 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.331160:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 9 pid: 24319 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.331193:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcbf4e66/0x6418c0ce308cea52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82d6 expref: 9 pid: 24319 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.331211:0:22796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797472.331231:0:22796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788797472.331237:0:22796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.331248:0:22796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.331294:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788797472.331364:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c3a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:2404:x1875689376753152:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 277us (9432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797472.331372:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 21 00010000:00010000:1.0:1788797472.332177:0:24321:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332192:0:24321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332221:0:24321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332230:0:24321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332238:0:24321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332246:0:24321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084ae00 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:1.0:1788797472.332250:0:24321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332259:0:24321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332286:0:24321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.332305:0:24321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2382d5/0x6418c0ce308cea59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.332389:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:2405:x1875689376753024:12345-192.168.202.33@tcp:1:lhsmtool_posix.0 Request processed in 15451us (15653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.332398:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 31 00000100:00100000:1.0:1788797472.340764:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.341630:0:24561:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753408 00000100:00100000:0.0:1788797472.341642:0:24561:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753408 00000100:00100000:2.0:1788797472.341989:0:24561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1788797472.342002:0:24561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+15:18840:x1875689376753408:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788797472.342092:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.342112:0:24561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 15 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.342127:0:24561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.342166:0:24561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 15 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.342180:0:24561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 15 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.342215:0:24561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499456:192.168.202.33@tcp:104: 00000100:00100000:2.0:1788797472.342308:0:24561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797472.346053:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797472.346145:0:24561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499456:192.168.202.33@tcp:104: 00010000:00010000:2.0:1788797472.346171:0:24561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797472.346237:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753536 00000100:00100000:3.0:1788797472.346244:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753536 00010000:00010000:3.0:1788797472.346291:0:22795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797472.346335:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 22 00000100:00100000:3.0:1788797472.346346:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+16:2405:x1875689376753536:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797472.346361:0:22795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797472.346646:0:22795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346678:0:22795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346768:0:22795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4000/0x6418c0ce308ce933 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca8274 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346822:0:22795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797472.346830:0:22795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 15 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346841:0:22795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346858:0:22795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346867:0:22795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.346891:0:22795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797472.346941:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+15:2405:x1875689376753536:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 597us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797472.346948:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 22 00010000:00010000:2.0:1788797472.347024:0:24561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347032:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347238:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347251:0:24561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 15 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347259:0:24561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347299:0:24561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 15 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.347314:0:24561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 15 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.347338:0:24561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499584:192.168.202.33@tcp:104: 00000100:00100000:2.0:1788797472.347412:0:24561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69240 going to sleep for 11 seconds 00000100:00100000:0.0:1788797472.354147:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797472.354329:0:24561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499584:192.168.202.33@tcp:104: 00010000:00010000:2.0:1788797472.354370:0:24561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.354621:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753664 00000100:00100000:1.0:1788797472.354629:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753664 00010000:00010000:1.0:1788797472.354668:0:22796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797472.354747:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:1.0:1788797472.354756:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c7503050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+16:2404:x1875689376753664:12345-192.168.202.33@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797472.354770:0:22796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797472.354777:0:22796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.354979:0:22796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.355004:0:22796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a22c3900c00/0x6418c0ce308cea2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82c1 expref: 16 pid: 22812 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.355019:0:22796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:1.0:1788797472.355035:0:22796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.355045:0:22796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.355053:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.355073:0:22796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797472.355172:0:24561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.355179:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788797472.355331:0:24561:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788797472.355479:0:24561:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788797472.355519:0:24561:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788797472.355606:0:24561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24561:1875689390499712:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788797472.355661:0:24561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797472.355696:0:24561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797472.355910:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c7503050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+18:2404:x1875689376753664:12345-192.168.202.33@tcp:103:ldlm_bl.0 Request processed in 1153us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.355920:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 23 00000100:00100000:1.0:1788797472.357148:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390499712 00000100:00100000:1.0:1788797472.357161:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390499712 00000100:00100000:1.0:1788797472.357219:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797472.357229:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24561:x1875689390499712:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788797472.357630:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24561:x1875689390499712:12345-0@lo:1000:mdt00_003.0 Request processed in 400us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.357649:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788797472.357747:0:24561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24561:1875689390499712:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788797472.357961:0:24561:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1788797472.358036:0:24561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24561:1875689390499840:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788797472.358072:0:24561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797472.358092:0:24561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d693c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797472.359152:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390499840 00000100:00100000:0.0:1788797472.359162:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390499840 00000100:00100000:0.0:1788797472.359216:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788797472.359225:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:24561:x1875689390499840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788797472.359642:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:24561:x1875689390499840:12345-0@lo:1000:mdt00_003.0 Request processed in 418us (1568us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788797472.359650:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797472.359733:0:24561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4027800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24561:1875689390499840:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788797472.359774:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359818:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359855:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359862:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b200 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.359866:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359875:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359889:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:2.0:1788797472.359892:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797472.359897:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359903:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b200/0x6418c0ce308cea67 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359937:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359944:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359949:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359955:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a23c12e4e00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.359958:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359974:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.359984:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797472.359986:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788797472.359993:0:24561:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.360004:0:24561:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.360013:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.360064:0:24561:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4c00/0x6418c0ce308ce9c6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82a5 expref: 18 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.360076:0:24561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4025880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499968:192.168.202.33@tcp:105: 00000100:00100000:2.0:1788797472.360130:0:24561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a23c7d69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797472.365119:0:24561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4025880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24561:1875689390499968:192.168.202.33@tcp:105: 00010000:00010000:2.0:1788797472.365154:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365166:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a23c12e4e00/0x6418c0ce308ce9bf lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365204:0:24561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365239:0:24561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365252:0:24561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365264:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365283:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365290:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365296:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b400 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.365299:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365308:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365328:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797472.365331:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797472.365343:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365349:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea6e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365360:0:24561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365381:0:24561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365387:0:24561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365392:0:24561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a240084b000 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:2.0:1788797472.365395:0:24561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365400:0:24561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365408:0:24561:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797472.365411:0:24561:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797472.365413:0:24561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.365419:0:24561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea60 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24561 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797472.366021:0:24561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+18:18840:x1875689376753408:12345-192.168.202.33@tcp:57:lhsmtool_posix.0 Request processed in 24018us (25263us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788797472.366032:0:24561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00000020:00080000:2.0:1788797472.366038:0:24561:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788797472.371672:0:22846:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788797472.371683:0:22846:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797472.371781:0:22846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788797472.371870:0:22846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788797472.375243:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797472.375755:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.376601:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376753920 00000100:00100000:3.0:1788797472.376614:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376753920 00000100:00100000:1.0:1788797472.377016:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754048 00000100:00100000:1.0:1788797472.377022:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754048 00000100:00100000:1.0:1788797472.377052:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 12 00000100:00100000:1.0:1788797472.377062:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+19:18840:x1875689376753920:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788797472.377953:0:22813:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788797472.378006:0:22813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1788797472.378050:0:22813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378067:0:22813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378079:0:22813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378087:0:22813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378094:0:22813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378100:0:22813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.378194:0:22813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788797472.378299:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18840:x1875689376753920:12345-192.168.202.33@tcp:35:lhsmtool_posix.0 Request processed in 1234us (3063us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788797472.378308:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 12 00000020:00080000:1.0:1788797472.378314:0:22813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788797472.379555:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 13 00000100:00100000:1.0:1788797472.379572:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18839:x1875689376754048:12345-192.168.202.33@tcp:49:bash.0 00000100:00100000:1.0:1788797472.379900:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f9088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18839:x1875689376754048:12345-192.168.202.33@tcp:49:bash.0 Request processed in 332us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.379907:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 13 00010000:00010000:2.0:1788797472.381926:0:22799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797472.381942:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.381954:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a2401514200 already unused, calling callback (ffffffffc0ead8b0) 00010000:00010000:2.0:1788797472.381974:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.381986:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.382004:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a23f7604c00) 00010000:00010000:2.0:1788797472.382007:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788797472.382012:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.382019:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a2401514200/0x6418c0ce308cea75 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.382034:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797472.382036:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797472.382038:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797472.384739:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.384981:0:24319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754176 00000100:00100000:1.0:1788797472.385006:0:24319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754176 00000100:00100000:1.0:1788797472.385091:0:24319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:1.0:1788797472.385098:0:24319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c4025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+7:18839:x1875689376754176:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:1.0:1788797472.385114:0:24319:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797472.385131:0:24319:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308cea7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82dd expref: -99 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797472.385154:0:24319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ee21f, atime: 0x6a9ee21d, ctime: 0x6a9ee21f, blocks: 0x0 00010000:00010000:1.0:1788797472.385175:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=732s v=(0 0) 00010000:00010000:1.0:1788797472.385180:0:24319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797472.385190:0:24319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308cea7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82dd expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.385207:0:24319:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008367939c/0x6418c0ce308cea7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82dd expref: 8 pid: 24319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797472.385218:0:24319:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a2401514a00, rc 0) 00000100:00100000:1.0:1788797472.385266:0:24319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c4025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:18839:x1875689376754176:12345-192.168.202.33@tcp:101:bash.0 Request processed in 169us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797472.385277:0:24319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 32 00000100:00100000:0.0:1788797472.392859:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797472.393049:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754304 00000100:00100000:2.0:1788797472.393061:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754304 00000100:00100000:2.0:1788797472.393174:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:2.0:1788797472.393185:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+20:18839:x1875689376754304:12345-192.168.202.33@tcp:101:bash.0 00010000:00010000:2.0:1788797472.393212:0:22810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797472.393236:0:22810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea83 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82e4 expref: -99 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.393290:0:22810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.393306:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.395371:0:22810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.395668:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b000/0x6418c0ce308cea83 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82e4 expref: 22 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.395689:0:22810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a240084b400/0x6418c0ce308cea8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82e4 expref: 21 pid: 22810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797472.395760:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:2.0:1788797472.395765:0:22810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797472.395770:0:22810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a240084b400, rc 0) 00000100:00100000:2.0:1788797472.396003:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c33b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18839:x1875689376754304:12345-192.168.202.33@tcp:101:bash.0 Request processed in 2818us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797472.396013:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:0.0:1788797472.405583:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:1.0:1788797472.406021:0:22813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754560 00000100:00100000:1.0:1788797472.406032:0:22813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754560 00000100:00100000:0.0:1788797472.406212:0:22813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 14 00000100:00100000:0.0:1788797472.406223:0:22813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+21:18839:x1875689376754560:12345-192.168.202.33@tcp:35:bash.0 00000001:00080000:0.0:1788797472.406498:0:22813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1788797472.406605:0:22813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1788797472.406731:0:22813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+24:18839:x1875689376754560:12345-192.168.202.33@tcp:35:bash.0 Request processed in 509us (1158us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1788797472.406739:0:22813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 14 00000020:00080000:0.0:1788797472.406743:0:22813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788797472.499060:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797472.512042:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.512337:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754816 00000100:00100000:3.0:1788797472.512348:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754816 00000100:00100000:3.0:1788797472.512702:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:3.0:1788797472.512730:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a2401699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+24:18850:x1875689376754816:12345-192.168.202.33@tcp:101:lfs.0 00010000:00010000:3.0:1788797472.512758:0:22812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797472.512782:0:22812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c09a2d5cdca82eb expref: -99 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797472.512937:0:22812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788797472.513037:0:22812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82eb expref: 26 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.513051:0:22812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a23d299e000) 00010000:00010000:3.0:1788797472.513054:0:22812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797472.513059:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.33@tcp remote: 0x5c09a2d5cdca82eb expref: 26 pid: 22812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.513074:0:22812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a24021dea00, rc 0) 00000100:00100000:3.0:1788797472.513140:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a2401699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18850:x1875689376754816:12345-192.168.202.33@tcp:101:lfs.0 Request processed in 413us (1107us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1788797472.513148:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:1.0:1788797472.522908:0:3609:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.523157:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376754944 00000100:00100000:3.0:1788797472.523167:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376754944 00000100:00100000:3.0:1788797472.523278:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:3.0:1788797472.523288:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18850:x1875689376754944:12345-192.168.202.33@tcp:34:lfs.0 00010000:00010000:3.0:1788797472.523397:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523418:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523462:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523479:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523487:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523494:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523576:0:22811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523585:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523603:0:22811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797472.523661:0:22811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523675:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523682:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523688:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523704:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021dea00 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797472.523708:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523716:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523728:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a23d299e200) 00010000:00010000:3.0:1788797472.523731:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797472.523736:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523743:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021dea00/0x6418c0ce308cea9f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523757:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523764:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523770:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523775:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021de600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797472.523777:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523783:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523973:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a23f9faf400) 00010000:00010000:3.0:1788797472.523976:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797472.523980:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.523986:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021de600/0x6418c0ce308ceaa6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524002:0:22811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524008:0:22811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524014:0:22811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524019:0:22811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a24021df600 already unused, calling callback (ffffffffc1abf4f0) 00010000:00010000:3.0:1788797472.524021:0:22811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524026:0:22811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524033:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a23d299e500) 00010000:00010000:3.0:1788797472.524035:0:22811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797472.524038:0:22811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797472.524043:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a24021df600/0x6418c0ce308ceaad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797472.524135:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c42b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18850:x1875689376754944:12345-192.168.202.33@tcp:34:lfs.0 Request processed in 847us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797472.524143:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:0.0:1788797472.528068:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:3.0:1788797472.528164:0:22814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755200 00000100:00100000:3.0:1788797472.528177:0:22814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755200 00000100:00100000:3.0:1788797472.528278:0:22814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:3.0:1788797472.528291:0:22814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+25:18850:x1875689376755200:12345-192.168.202.33@tcp:35:lfs.0 00000100:00100000:3.0:1788797472.528557:0:22814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23f90c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+26:18850:x1875689376755200:12345-192.168.202.33@tcp:35:lfs.0 Request processed in 269us (499us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1788797472.528565:0:22814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15 00000100:00100000:1.0:1788797473.331192:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390500096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788797473.331331:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797473.331552:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500096 00000100:00100000:2.0:1788797473.331565:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500096 00000100:00100000:2.0:1788797473.331672:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797473.331687:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390500096:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788797473.331728:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788797473.331729:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788797473.331904:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c2344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875689390500096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797473.331913:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797473.334943:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1875689390500096:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788797473.523405:0:22798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797473.844754:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c2346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390500224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797473.844895:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.844964:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797473.844974:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390500352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797473.845006:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.845169:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500352 00000100:00100000:1.0:1788797473.845236:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500352 00000100:00100000:1.0:1788797473.845305:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788797473.845317:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390500352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797473.845367:0:22816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797473.845993:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875689390500352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 674us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.846004:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788797473.846086:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c3a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390500352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797473.847504:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797473.847531:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390500480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797473.847608:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.847664:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500224 00000100:00100000:1.0:1788797473.847674:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500224 00000100:00100000:1.0:1788797473.847734:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500480 00000100:00100000:1.0:1788797473.847737:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500480 00000100:00100000:1.0:1788797473.847760:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797473.847769:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390500224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788797473.847825:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797473.847895:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390500224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.847914:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797473.847934:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788797473.847940:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390500480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797473.847951:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1788797473.847979:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875689390500480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.847985:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788797473.848002:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797473.848042:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a23c6d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1875689390500480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797473.848080:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c2346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390500224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797473.848529:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390500608:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.848568:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.848609:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390501120:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.848636:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.848654:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875689390501632:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.848676:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.848701:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788797473.848707:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390500736:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.848734:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.848755:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390501248:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.848775:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.848853:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501120 00000100:00100000:1.0:1788797473.848859:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501120 00000100:00100000:1.0:1788797473.848896:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501632 00000100:00100000:1.0:1788797473.848909:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501632 00000100:00100000:1.0:1788797473.848934:0:22812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501248 00000100:00100000:1.0:1788797473.848937:0:22812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501248 00000100:00100000:1.0:1788797473.848953:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797473.848960:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390501120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849005:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875689390501120:12345-0@lo:400:kworker.0 Request processed in 45us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.849012:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797473.849027:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788797473.849034:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875689390501632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849061:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875689390501632:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.849066:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788797473.849078:0:22812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788797473.849083:0:22812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390501248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849111:0:22812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875689390501248:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.849116:0:22812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788797473.849136:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500736 00000100:00100000:1.0:1788797473.849140:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500736 00000100:00100000:1.0:1788797473.849528:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788797473.849538:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390500736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849573:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3616:x1875689390500736:12345-0@lo:400:kworker.0 Request processed in 37us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.849579:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788797473.849606:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797473.849611:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788797473.849622:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797473.849637:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390500992:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849670:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.849694:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390501504:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849717:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.849737:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797473.849744:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390500864:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.849782:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c204ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390501376:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849824:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797473.849862:0:22815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500992 00000100:00100000:1.0:1788797473.849867:0:22815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500992 00000100:00100000:1.0:1788797473.849894:0:22815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797473.849901:0:22815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.849939:0:22815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875689390500992:12345-0@lo:400:kworker.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.849945:0:22815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797473.849962:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501504 00000100:00100000:1.0:1788797473.849966:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501504 00000100:00100000:1.0:1788797473.849990:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500864 00000100:00100000:1.0:1788797473.849993:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500864 00000100:00100000:1.0:1788797473.850004:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501376 00000100:00100000:1.0:1788797473.850007:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501376 00000100:00100000:1.0:1788797473.850023:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788797473.850029:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875689390501504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850059:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875689390501504:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.850077:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788797473.850090:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788797473.850095:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390500864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850125:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875689390500864:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.850130:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788797473.850142:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788797473.850148:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23c6d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390501376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850186:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23c6d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875689390501376:12345-0@lo:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797473.850192:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788797473.850208:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788797473.850211:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797473.850256:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1875689390500736:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850270:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1875689390501248:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850281:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875689390501120:0@lo:400:kworker.0 00010000:00080000:1.0:1788797473.850295:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c204c000 x1875689390501632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797473.850307:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1875689390501632:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850343:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875689390500864:0@lo:400:kworker.0 00010000:00080000:1.0:1788797473.850353:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a22c204ce00 x1875689390501376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797473.850363:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1875689390501376:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850381:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1875689390500992:0@lo:400:kworker.0 00000100:00100000:1.0:1788797473.850389:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c204e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1875689390501504:0@lo:400:kworker.0 00000100:00100000:2.0:1788797473.853331:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390500608 00000100:00100000:2.0:1788797473.853350:0:22804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390500608 00000100:00100000:2.0:1788797473.853462:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788797473.853474:0:22804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3616:x1875689390500608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797473.853611:0:22804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42e4a701-62a9-467c-87db-46cabbbe5ca1+24:3616:x1875689390500608:12345-0@lo:400:kworker.0 Request processed in 139us (5040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797473.853619:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788797473.853711:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42e4a701-62a9-467c-87db-46cabbbe5ca1:3616:1875689390500608:0@lo:400:kworker.0 00000100:00100000:0.0:1788797473.858877:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c385ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390501760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797473.858988:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797473.859064:0:23836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501760 00000100:00100000:0.0:1788797473.859075:0:23836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501760 00000100:00100000:0.0:1788797473.859135:0:23836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788797473.859146:0:23836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390501760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797473.860279:0:23836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788797473.860401:0:23836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875689390501760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1244us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797473.860550:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c385ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1875689390501760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797473.860680:0:23836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1788797474.551652:0:23967:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788797474.573190:0:25908:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:0.0:1788797474.809421:0:23568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797475.571118:0:22799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797475.612719:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.612930:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:2.0:1788797475.613369:0:24321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755456 00000100:00100000:2.0:1788797475.613383:0:24321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755456 00000100:00100000:1.0:1788797475.613489:0:24324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755328 00000100:00100000:1.0:1788797475.613495:0:24324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755328 00000100:00100000:2.0:1788797475.613507:0:24321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 33 00000100:00100000:2.0:1788797475.613519:0:24321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:2407:x1875689376755456:12345-192.168.202.33@tcp:16:kworker.0 00002000:00100000:1.0:1788797475.613541:0:24324:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9a22c385dc00 x1875689376755328/t0(0) o4->6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp:146/0 lens 504/0 e 0 to 0 dl 1788797486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00000100:00100000:2.0:1788797475.613678:0:24321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+9:2407:x1875689376755456:12345-192.168.202.33@tcp:16:kworker.0 Request processed in 160us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.613686:0:24321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 33 00002000:00100000:1.0:1788797475.614024:0:24324:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a22c385dc00 with x1875689376755328 ext(0->8) 00002000:00010000:1.0:1788797475.614032:0:24324:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a22c385dc00 00000100:00100000:1.0:1788797475.614063:0:24324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 0 00000100:00100000:1.0:1788797475.614072:0:24324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+8:2406:x1875689376755328:12345-192.168.202.33@tcp:4:bash.0 00000100:00080000:3.0:1788797475.614681:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797475.617694:0:24324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+10:2406:x1875689376755328:12345-192.168.202.33@tcp:4:bash.0 Request processed in 3604us (4973us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788797475.617713:0:24324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 0 00002000:00100000:1.0:1788797475.617731:0:24324:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9a22c385dc00 x1875689376755328/t12884901895(0) o4->6e002fc6-6c57-4c3f-b3af-ceff1e7642d8@192.168.202.33@tcp:146/0 lens 504/448 e 0 to 0 dl 1788797486 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788797475.617743:0:24324:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a22c385dc00 with x1875689376755328 ext(0->8) 00002000:00010000:1.0:1788797475.617752:0:24324:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a22c385dc00 00000100:00100000:0.0:1788797475.628257:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628316:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628359:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628429:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628447:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628475:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628503:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp) 00000100:00100000:0.0:1788797475.628545:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376756352 00000100:00100000:0.0:1788797475.628559:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376756352 00000100:00100000:0.0:1788797475.628634:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755968 00000100:00100000:0.0:1788797475.628637:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755968 00000100:00100000:0.0:1788797475.628657:0:24712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376756480 00000100:00100000:0.0:1788797475.628659:0:24712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376756480 00000100:00100000:0.0:1788797475.628703:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:0.0:1788797475.628717:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756352:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797475.628876:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 161us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.629354:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755840 00000100:00100000:2.0:1788797475.629361:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755840 00000100:00100000:2.0:1788797475.629405:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376756096 00000100:00100000:2.0:1788797475.629409:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376756096 00000100:00100000:2.0:1788797475.629429:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755712 00000100:00100000:2.0:1788797475.629432:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755712 00000100:00100000:2.0:1788797475.629445:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376756224 00000100:00100000:2.0:1788797475.629448:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376756224 00000100:00100000:2.0:1788797475.629470:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1788797475.629479:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2404:x1875689376755840:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797475.629524:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2404:x1875689376755840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 47us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.629532:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 70 00000100:00100000:2.0:1788797475.629566:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:2.0:1788797475.629573:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2404:x1875689376756096:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797475.629602:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+6:2404:x1875689376756096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 29us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.629608:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 71 00000100:00100000:2.0:1788797475.629620:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:2.0:1788797475.629626:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+26:2404:x1875689376755712:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797475.629656:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+26:2404:x1875689376755712:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 30us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.629662:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 72 00000100:00100000:2.0:1788797475.629675:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:2.0:1788797475.629682:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756224:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:2.0:1788797475.629704:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756224:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 23us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797475.629710:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 73 00000100:00100000:0.0:1788797475.630509:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 24 00000100:00100000:0.0:1788797475.630538:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1788797475.630552:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2404:x1875689376755968:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797475.630599:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e002fc6-6c57-4c3f-b3af-ceff1e7642d8+5:2404:x1875689376755968:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797475.630605:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 25 00000100:00100000:0.0:1788797475.630618:0:24712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00100000:0.0:1788797475.630625:0:24712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756480:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:0.0:1788797475.630651:0:24712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62a16f93-c353-4076-bef0-cc464ba0d33d+5:2404:x1875689376756480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 27us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797475.630657:0:24712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 26 00000100:00080000:3.0:1788797475.630836:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797475.630842:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788797475.630846:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797475.630849:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788797475.631126:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689376755584 00000100:00100000:1.0:1788797475.631137:0:22805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689376755584 00000100:00100000:1.0:1788797475.631200:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 170 00000100:00100000:1.0:1788797475.631209:0:22805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2404:x1875689376755584:12345-192.168.202.33@tcp:400:kworker.0 00000100:00100000:1.0:1788797475.631243:0:22805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a23fa754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a512648-c64e-4a48-9f3b-a8a92c7adc91+13:2404:x1875689376755584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 35us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797475.631270:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 170 00000100:00100000:0.0:1788797476.407476:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797476.407514:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a22c4024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390501888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797476.407616:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797476.408028:0:24323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875689390501888 00000100:00100000:1.0:1788797476.408039:0:24323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875689390501888 00000100:00100000:1.0:1788797476.408122:0:24323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797476.408134:0:24323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a22c385e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875689390501888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797476.408165:0:24323:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797476.408230:0:24323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a22c385e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875689390501888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797476.408238:0:24323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797476.408295:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a22c4024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1875689390501888:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788797476.408399:0:22806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788797476.598253:0:24815:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14875 lines, 14875 kept, 0 dropped, 0 bad.