00000040:00080000:0.0F:1788796959.254171:0:17973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0F:1788796959.507885:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796959.507919:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984646016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788796959.507982:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796959.508282:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984646144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788796959.508309:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788796959.508367:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646016 00000100:00100000:1.0:1788796959.508382:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646016 00000100:00100000:1.0:1788796959.508422:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646144 00000100:00100000:1.0:1788796959.508425:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646144 00000100:00100000:1.0:1788796959.508439:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788796959.508448:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984646016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788796959.508482:0:17226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788796959.508539:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984646016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796959.508546:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788796959.508564:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788796959.508570:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984646144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788796959.508587:0:17226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0F:1788796959.511268:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984646016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788796959.517653:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984646144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9073us (9333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796959.517667:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788796959.517896:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984646144:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788796960.023181:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788796960.032341:0:18724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000020:00000080:0.0:1788796960.032352:0:18724:0:(genops.c:885:class_export_put()) final put ffff8fb4aa025800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000001:00080000:0.0:1788796960.032387:0:18724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788796960.032398:0:18724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000020:00000080:3.0:1788796960.032756:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4aa025800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d for lustre-OST0000 00000020:00000080:3.0:1788796960.032804:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4aa026000 for lustre-OST0000 00000001:00080000:3.0:1788796960.035270:0:17201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:3.0:1788796960.035299:0:17201:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fb4b9f04540 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788796960.035306:0:17201:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fb4bc000a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fb4b9f04f00 00000020:00080000:3.0:1788796960.035309:0:17201:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fb4bc000000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fb3879eac00 00010000:00010000:3.0:1788796960.035341:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035352:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035361:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035369:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788796960.035374:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035383:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035399:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fb4907bd000) 00010000:00010000:3.0:1788796960.035408:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796960.035413:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796960.035418:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29c000/0x500835b7bd266170 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17221 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788796960.035441:0:17260:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:3.0:1788796960.035513:0:17260:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788796960.547013:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796960.547037:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984646272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796960.547116:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796960.547204:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646272 00000100:00100000:1.0:1788796960.547213:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646272 00000100:00100000:1.0:1788796960.548848:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788796960.548861:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984646272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796960.548891:0:18731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788796960.548956:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984646272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796960.548963:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796960.556993:0:3654:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788796960.557006:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fb4bfacce00, transno 8589934596 00000004:00080000:0.0:1788796960.557018:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788796960.557063:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984646272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796961.044624:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788796961.044777:0:17256:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788796961.044783:0:17256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796961.044803:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788796961.044812:0:17256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788796962.069095:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796962.122788:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796962.122905:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963589760 00000100:00100000:1.0:1788796962.122916:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963589760 00000100:00100000:1.0:1788796962.122992:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:1.0:1788796962.123003:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:15618:x1875688963589760:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788796962.123126:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:15618:x1875688963589760:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 Request processed in 126us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796962.123132:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00080000:2.0:1788796962.123241:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796962.129237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788796962.129803:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963589888 00000100:00100000:2.0:1788796962.129817:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963589888 00000100:00100000:2.0:1788796962.130068:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00100000:2.0:1788796962.130091:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:15618:x1875688963589888:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788796962.130239:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:15618:x1875688963589888:12345-192.168.201.27@tcp:60:lhsmtool_posix.0 Request processed in 160us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796962.130247:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 75 00000100:00080000:1.0:1788796962.131426:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788796962.152967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788796962.153158:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590144 00000100:00100000:3.0:1788796962.153173:0:17223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590144 00000100:00100000:3.0:1788796962.153250:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1788796962.153263:0:17223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38690cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:15618:x1875688963590144:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788796962.153590:0:17223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38690cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+13:15618:x1875688963590144:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 328us (636us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788796962.153600:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00010000:00010000:0.0:1788796963.092235:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796963.604420:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796963.604455:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984646400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788796963.604552:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796963.604713:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646400 00000100:00100000:0.0:1788796963.604725:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646400 00000100:00100000:0.0:1788796963.604802:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788796963.604811:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984646400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788796963.604849:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788796963.604908:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984646400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796963.604916:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796963.605047:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984646400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788796963.605240:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796964.117039:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796964.117291:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984646528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796964.117365:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.117991:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646528 00000100:00100000:2.0:1788796964.117999:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646528 00000100:00100000:2.0:1788796964.118074:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788796964.118086:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984646528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796964.118115:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788796964.118168:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984646528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796964.118176:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788796964.118243:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796964.118513:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984646528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796964.119580:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796964.119608:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984646656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788796964.119750:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796964.119826:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646656 00000100:00100000:3.0:1788796964.119835:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646656 00000100:00100000:3.0:1788796964.119909:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796964.119919:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984646656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788796964.119944:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788796964.120002:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984646656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.120009:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788796964.120315:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796964.120858:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984646656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788796964.130784:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984646912:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.130908:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3655:1875688984646784:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.130977:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.131020:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984647296:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131060:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.131081:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1875688984647808:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131105:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.131129:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788796964.131135:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875688984647168:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131156:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.131171:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984647680:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131188:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.131232:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647808 00000100:00100000:1.0:1788796964.131241:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647808 00000100:00100000:1.0:1788796964.131292:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647168 00000100:00100000:1.0:1788796964.131295:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647168 00000100:00100000:1.0:1788796964.131310:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647680 00000100:00100000:1.0:1788796964.131313:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647680 00000100:00100000:1.0:1788796964.131331:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788796964.131356:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875688984647808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131410:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875688984647808:12345-0@lo:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.131418:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788796964.131440:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788796964.131446:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875688984647168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131474:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875688984647168:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.131480:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788796964.131495:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788796964.131502:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984647680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131528:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984647680:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.131534:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788796964.131573:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875688984647168:0@lo:400:kworker.0 00010000:00080000:1.0:1788796964.131587:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bd5ded80 x1875688984647680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796964.131598:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984647680:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.131606:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3655:1875688984647808:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.132487:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.132541:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984647424:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.132567:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.132589:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984647936:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.132607:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.132622:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788796964.132628:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984647040:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.132665:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.132713:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984647552:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.132732:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796964.132758:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646784 00000100:00100000:2.0:1788796964.132764:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646784 00000100:00100000:3.0:1788796964.132831:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647424 00000100:00100000:3.0:1788796964.132847:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647424 00000100:00100000:3.0:1788796964.132911:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647936 00000100:00100000:3.0:1788796964.132915:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647936 00000100:00100000:3.0:1788796964.132939:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647552 00000100:00100000:3.0:1788796964.132942:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647552 00000100:00100000:3.0:1788796964.132964:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788796964.132974:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984647424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796964.133099:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984647424:12345-0@lo:400:kworker.0 Request processed in 126us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.133106:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788796964.133124:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788796964.133130:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984647936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796964.133160:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984647936:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.133166:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788796964.133177:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788796964.133183:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984647552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796964.133211:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984647552:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.133231:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788796964.133270:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788796964.133275:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796964.134488:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647296 00000100:00100000:1.0:1788796964.134503:0:17961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647296 00000100:00100000:1.0:1788796964.134554:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984646912 00000100:00100000:1.0:1788796964.134557:0:17961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984646912 00000100:00100000:1.0:1788796964.134573:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796964.134582:0:17961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984647296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.134670:0:17961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984647296:12345-0@lo:400:kworker.0 Request processed in 89us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.134678:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796964.134724:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788796964.134731:0:17961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984646912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.134761:0:17961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984646912:12345-0@lo:400:kworker.0 Request processed in 32us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.134767:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788796964.134939:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788796964.134946:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3655:x1875688984646784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.134981:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3655:x1875688984646784:12345-0@lo:400:kworker.0 Request processed in 35us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796964.134986:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788796964.135023:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984647040 00000100:00100000:2.0:1788796964.135028:0:18730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984647040 00000100:00100000:2.0:1788796964.135076:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788796964.135082:0:18730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984647040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.135112:0:18730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984647040:12345-0@lo:400:kworker.0 Request processed in 30us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796964.135117:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788796964.135140:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796964.135161:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984647040:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.135172:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984647552:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.135181:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984646912:0@lo:400:kworker.0 00000100:00100000:2.0:1788796964.135192:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984647424:0@lo:400:kworker.0 00010000:00080000:2.0:1788796964.135205:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bd5dd180 x1875688984647936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796964.135229:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984647936:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.136284:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984647296:0@lo:400:kworker.0 00000100:00100000:1.0:1788796964.136320:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bd5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3655:1875688984646784:0@lo:400:kworker.0 00000100:00100000:0.0:1788796964.163500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796964.163550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796964.163571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796964.163600:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796964.163630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788796964.163782:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590400 00000100:00100000:3.0:1788796964.163796:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590400 00000100:00100000:3.0:1788796964.163874:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590912 00000100:00100000:3.0:1788796964.163878:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590912 00000100:00100000:3.0:1788796964.163909:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590528 00000100:00100000:3.0:1788796964.163912:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590528 00000100:00100000:3.0:1788796964.163930:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:3.0:1788796964.163942:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+13:2411:x1875688963590400:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796964.164074:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+13:2411:x1875688963590400:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 134us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.164083:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 94 00000100:00100000:3.0:1788796964.164105:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1788796964.164113:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2411:x1875688963590912:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796964.164139:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2411:x1875688963590912:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.164146:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 95 00000100:00100000:3.0:1788796964.164159:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00100000:3.0:1788796964.164166:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:2411:x1875688963590528:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796964.164190:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:2411:x1875688963590528:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.164196:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 96 00000100:00080000:3.0:1788796964.164217:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788796964.164235:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796964.165277:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590656 00000100:00100000:1.0:1788796964.165296:0:18729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590656 00000100:00100000:1.0:1788796964.165377:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:1.0:1788796964.165387:0:18729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+6:2411:x1875688963590656:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788796964.165476:0:18729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+6:2411:x1875688963590656:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 90us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.165484:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:1.0:1788796964.165513:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590272 00000100:00100000:1.0:1788796964.165517:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590272 00000100:00100000:1.0:1788796964.165545:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 173 00000100:00100000:1.0:1788796964.165552:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2411:x1875688963590272:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788796964.165578:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2411:x1875688963590272:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.165584:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 173 00000100:00080000:1.0:1788796964.165797:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796964.168872:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796964.168974:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963590784 00000100:00100000:0.0:1788796964.168987:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963590784 00000100:00100000:0.0:1788796964.169095:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00100000:0.0:1788796964.169108:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+6:2411:x1875688963590784:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788796964.169212:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+6:2411:x1875688963590784:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 108us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796964.169221:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 97 00000100:00080000:1.0:1788796964.171005:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796964.628193:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796964.629201:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984648064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788796964.629306:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796964.629377:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648064 00000100:00100000:1.0:1788796964.629388:0:17961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648064 00000100:00100000:1.0:1788796964.629447:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788796964.629457:0:17961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984648064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788796964.629507:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788796964.629563:0:17961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984648064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796964.629570:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788796964.629636:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984648064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788796964.630444:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796964.630463:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984648192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788796964.630528:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796964.631540:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648192 00000100:00100000:3.0:1788796964.631553:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648192 00000100:00100000:3.0:1788796964.631663:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788796964.631676:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984648192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788796964.631740:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788796964.631835:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984648192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796964.631842:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788796964.635004:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984648192:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788796965.051250:0:20597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:02:42 (1788796962) 00010000:00010000:2.0:1788796965.139898:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796965.149428:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000020:00000080:3.0:1788796965.149440:0:19542:0:(genops.c:885:class_export_put()) final put ffff8fb4bd1b4800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000001:00100000:3.0:1788796965.149484:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:3.0:1788796965.149487:0:19542:0:(genops.c:885:class_export_put()) final put ffff8fb38150a000/85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:2.0:1788796965.149541:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bd1b4800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d for lustre-OST0001 00000020:00000080:2.0:1788796965.149632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb38150a000/85247cf7-c6b3-42ef-aa8e-1ad69122b44f for lustre-OST0001 00000020:00000080:2.0:1788796965.149663:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb387637800 for lustre-OST0001 00000020:00000080:2.0:1788796965.149712:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb38754e000 for lustre-OST0001 00000100:00100000:0.0:1788796965.653793:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4badb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984648320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796965.653883:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796965.653956:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648320 00000100:00100000:0.0:1788796965.653967:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648320 00000100:00100000:0.0:1788796965.654046:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788796965.654058:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984648320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796965.654099:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788796965.654151:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984648320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796965.654172:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788796965.654231:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4badb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984648320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788796966.170394:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788796966.171877:0:17201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788796966.171896:0:17201:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1788796966.171957:0:17260:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1788796966.171971:0:17260:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:2.0:1788796967.192728:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796968.230588:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796968.725139:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984648448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788796968.725248:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796968.725993:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648448 00000100:00100000:3.0:1788796968.726009:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648448 00000100:00100000:3.0:1788796968.726107:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796968.726121:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984648448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788796968.726169:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788796968.726258:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984648448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796968.726265:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788796968.726414:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984648448:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788796968.726611:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796969.236217:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796969.236604:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984648960:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.236743:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.236814:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984649472:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.236836:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.236854:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1875688984649984:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.236879:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.236907:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788796969.236914:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3656:1875688984648576:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.236948:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.236989:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984649088:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237011:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.237040:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb488ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984649600:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237063:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.237079:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984650112:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237098:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796969.237136:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648960 00000100:00100000:2.0:1788796969.237146:0:19034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648960 00000100:00100000:2.0:1788796969.237206:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649472 00000100:00100000:2.0:1788796969.237210:0:19034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649472 00000100:00100000:2.0:1788796969.237231:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788796969.237240:0:19034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984648960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237302:0:19034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984648960:12345-0@lo:400:kworker.0 Request processed in 63us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237309:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788796969.237327:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788796969.237333:0:19034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984649472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237375:0:19034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984649472:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237381:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788796969.237401:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648576 00000100:00100000:2.0:1788796969.237405:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648576 00000100:00100000:2.0:1788796969.237430:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788796969.237448:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3656:x1875688984648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237478:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3656:x1875688984648576:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237484:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788796969.237516:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649984 00000100:00100000:2.0:1788796969.237519:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649984 00000100:00100000:2.0:1788796969.237551:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649088 00000100:00100000:2.0:1788796969.237554:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649088 00000100:00100000:2.0:1788796969.237564:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649600 00000100:00100000:2.0:1788796969.237566:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649600 00000100:00100000:2.0:1788796969.237577:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650112 00000100:00100000:2.0:1788796969.237579:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650112 00000100:00100000:2.0:1788796969.237594:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788796969.237600:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875688984649984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237633:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875688984649984:12345-0@lo:400:kworker.0 Request processed in 34us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237639:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788796969.237651:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788796969.237657:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984649088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237715:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984649088:12345-0@lo:400:kworker.0 Request processed in 58us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237721:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788796969.237734:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788796969.237740:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984649600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237766:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984649600:12345-0@lo:400:kworker.0 Request processed in 26us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237771:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788796969.237781:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788796969.237787:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984650112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237809:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984650112:12345-0@lo:400:kworker.0 Request processed in 23us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.237814:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788796969.237859:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3656:1875688984648576:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237884:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984649088:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237893:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb488ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984649600:0@lo:400:kworker.0 00010000:00080000:2.0:1788796969.237907:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4b9ecbb80 x1875688984650112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796969.237918:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984650112:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237927:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984648960:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237935:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984649472:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.237944:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3656:1875688984649984:0@lo:400:kworker.0 00000100:00080000:1.0:1788796969.238746:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788796969.238756:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796969.238761:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796969.239107:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984648704:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239193:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239247:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984649216:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239271:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239299:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984649728:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239326:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239371:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788796969.239379:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984648832:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239407:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239427:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984649344:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239450:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239466:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984649856:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239488:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796969.239539:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649728 00000100:00100000:0.0:1788796969.239547:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649728 00000100:00100000:0.0:1788796969.239603:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649856 00000100:00100000:0.0:1788796969.239607:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649856 00000100:00100000:0.0:1788796969.239627:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796969.239636:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875688984649728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239739:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875688984649728:12345-0@lo:400:kworker.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796969.239746:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796969.239782:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796969.239789:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984649856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239819:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984649856:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796969.239825:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796969.239853:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648832 00000100:00100000:0.0:1788796969.239857:0:19034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648832 00000100:00100000:0.0:1788796969.239882:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649344 00000100:00100000:0.0:1788796969.239885:0:19034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649344 00000100:00100000:0.0:1788796969.239899:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796969.239905:0:19034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984648832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.239935:0:19034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984648832:12345-0@lo:400:kworker.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796969.239941:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788796969.240163:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984648704 00000100:00100000:1.0:1788796969.240168:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984648704 00000100:00100000:1.0:1788796969.240202:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984649216 00000100:00100000:1.0:1788796969.240205:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984649216 00000100:00100000:1.0:1788796969.240219:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788796969.240226:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984648704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796969.240269:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984648704:12345-0@lo:400:kworker.0 Request processed in 45us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796969.240287:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788796969.240303:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788796969.240309:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984649216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796969.240341:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984649216:12345-0@lo:400:kworker.0 Request processed in 33us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796969.240358:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788796969.240567:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984650368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796969.240609:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796969.240647:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796969.240653:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984650240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788796969.240675:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796969.240718:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650368 00000100:00100000:3.0:1788796969.240723:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650368 00000100:00100000:3.0:1788796969.240747:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650240 00000100:00100000:3.0:1788796969.240750:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650240 00000100:00100000:3.0:1788796969.240761:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796969.240767:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984650368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796969.240794:0:18731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788796969.240831:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984650368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.240837:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796969.240851:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796969.240856:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984650240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788796969.240886:0:18731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788796969.240911:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984650240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.240917:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796969.240991:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984650240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788796969.241005:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984650368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796969.241109:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788796969.241119:0:19034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984649344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.241153:0:19034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984649344:12345-0@lo:400:kworker.0 Request processed in 37us (1702us total) trans 0 rc 0/0 00000100:00080000:2.0:1788796969.244218:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796969.244238:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788796969.244242:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796969.244583:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984648832:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.244610:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984649344:0@lo:400:kworker.0 00010000:00080000:2.0:1788796969.244629:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4b9ec9c00 x1875688984649856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796969.244641:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984649856:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.244655:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.244668:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984649216:0@lo:400:kworker.0 00000100:00100000:2.0:1788796969.244706:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984649728:0@lo:400:kworker.0 00000100:00100000:0.0:1788796969.272869:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788796969.292439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796969.292504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796969.292743:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591040 00000100:00100000:1.0:1788796969.292759:0:17216:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591040 00000100:00100000:1.0:1788796969.292826:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 175 00000100:00100000:1.0:1788796969.292839:0:17216:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2408:x1875688963591040:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788796969.292971:0:17216:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2408:x1875688963591040:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 134us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796969.292980:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 175 00000100:00100000:0.0:1788796969.298060:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796969.302543:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788796969.307566:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591296 00000100:00100000:2.0:1788796969.307759:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591296 00000100:00100000:2.0:1788796969.311542:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591552 00000100:00100000:2.0:1788796969.311570:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591552 00000100:00100000:2.0:1788796969.311788:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:2.0:1788796969.311801:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:2408:x1875688963591296:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796969.312051:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00100000:3.0:1788796969.312063:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4badb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+6:2408:x1875688963591552:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1788796969.312209:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:2408:x1875688963591296:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 410us (19703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.312217:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 104 00000100:00100000:2.0:1788796969.312245:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591168 00000100:00100000:2.0:1788796969.312250:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591168 00000100:00100000:2.0:1788796969.312274:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 106 00000100:00100000:2.0:1788796969.312280:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4830f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:2408:x1875688963591168:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796969.327097:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4badb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+6:2408:x1875688963591552:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 15015us (29033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.327142:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 105 00000100:00080000:3.0:1788796969.327216:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796969.327223:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788796969.329721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796969.329773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796969.329825:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591680 00000100:00100000:0.0:1788796969.329838:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591680 00000100:00100000:0.0:1788796969.329936:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00100000:0.0:1788796969.329948:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2408:x1875688963591680:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788796969.330060:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2408:x1875688963591680:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796969.330069:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 107 00000100:00080000:3.0:1788796969.331837:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788796969.331895:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591424 00000100:00100000:3.0:1788796969.331912:0:18730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591424 00000100:00100000:3.0:1788796969.332016:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:3.0:1788796969.332027:0:18730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+6:2408:x1875688963591424:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788796969.332117:0:18730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+6:2408:x1875688963591424:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 92us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796969.332125:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00080000:3.0:1788796969.332153:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796969.336501:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4830f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:2408:x1875688963591168:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24196us (33963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796969.336524:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 106 00000040:00080000:1.0:1788796969.492508:0:17973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788796969.748730:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984650496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788796969.748840:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796969.749198:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650496 00000100:00100000:1.0:1788796969.749210:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650496 00000100:00100000:1.0:1788796969.749287:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788796969.749299:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984650496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788796969.749343:0:17226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788796969.749405:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984650496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796969.749412:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788796969.750105:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984650496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788796969.750133:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796969.750145:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984650624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788796969.750287:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796969.751056:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650624 00000100:00100000:1.0:1788796969.751067:0:17961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650624 00000100:00100000:1.0:1788796969.751142:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788796969.751279:0:17961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984650624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788796969.751347:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788796969.751508:0:17961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984650624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 356us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796969.751517:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788796969.756014:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984650624:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788796970.262354:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796970.551616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796970.551815:0:20248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591808 00000100:00100000:0.0:1788796970.551830:0:20248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591808 00000100:00100000:0.0:1788796970.551921:0:20248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:0.0:1788796970.551962:0:20248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2410:x1875688963591808:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796970.551982:0:20248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796970.552008:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4c20e6800/0x500835b7bd265e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5ddca expref: 13 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796970.552032:0:20248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796970.552111:0:20248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddedfdb3-02b5-437c-96fb-06bed3436b53+12:2410:x1875688963591808:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 179us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796970.552118:0:20248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:1.0:1788796970.555167:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796970.555215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796970.555337:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963591936 00000100:00100000:0.0:1788796970.555351:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963591936 00000100:00100000:0.0:1788796970.555430:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963592064 00000100:00100000:0.0:1788796970.555433:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963592064 00000100:00100000:0.0:1788796970.555467:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1788796970.555481:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+13:2410:x1875688963591936:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796970.555504:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796970.555539:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd0800/0x500835b7bd265e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5ddfb expref: 13 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796970.555592:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796970.555674:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+12:2410:x1875688963591936:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 196us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796970.555710:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1788796970.555730:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:0.0:1788796970.555736:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+11:2408:x1875688963592064:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796970.555744:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796970.555754:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29cc00/0x500835b7bd265e91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5deb1 expref: 11 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796970.555763:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796970.555782:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+10:2408:x1875688963592064:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796970.555788:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1788796970.559640:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796970.559894:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963592320 00000100:00100000:1.0:1788796970.559909:0:18729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963592320 00000100:00100000:1.0:1788796970.559994:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:1.0:1788796970.560006:0:18729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+6:2407:x1875688963592320:12345-192.168.201.27@tcp:9:umount.0 00000020:00000080:1.0:1788796970.560054:0:18729:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265e28 00000020:00010000:1.0:1788796970.560064:0:18729:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8fb38150a800: total 0 00000100:00080000:1.0:1788796970.560071:0:18729:0:(import.c:65:import_set_state_nolock()) ffff8fb38150e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796970.560169:0:18729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788796970.560393:0:18729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+4:2407:x1875688963592320:12345-192.168.201.27@tcp:9:umount.0 Request processed in 389us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796970.560402:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00000020:00010000:2.0:1788796970.560657:0:17209:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8fb38150a800: total 0 00010000:00010000:2.0:1788796970.560663:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796970.560764:0:17209:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fb38150a800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788796970.560807:0:17209:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788796970.560811:0:17209:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788796953 -> 1788796954 00002000:00010000:2.0:1788796970.560831:0:17209:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788796953 -> 1788796954 00002000:00010000:2.0:1788796970.560834:0:17209:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788796970.560871:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd26619a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5df91 expref: 3 pid: 18730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796970.560902:0:17209:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fb38150a800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788796970.560916:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796970.560918:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796970.560920:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796970.584428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788796970.584788:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593216 00000100:00100000:3.0:1788796970.584803:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593216 00000100:00100000:3.0:1788796970.584894:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 76 00000100:00100000:3.0:1788796970.584907:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+12:2407:x1875688963593216:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:3.0:1788796970.584969:0:17220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265e1a 00000020:00010000:3.0:1788796970.584993:0:17220:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8fb38150d000: total 0 00000100:00080000:3.0:1788796970.585000:0:17220:0:(import.c:65:import_set_state_nolock()) ffff8fb381508800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796970.585049:0:17220:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:3.0:1788796970.585370:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+11:2407:x1875688963593216:12345-192.168.201.27@tcp:39:umount.0 Request processed in 464us (960us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788796970.585380:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 76 00000020:00010000:1.0:1788796970.586130:0:17210:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8fb38150d000: total 0 00010000:00010000:1.0:1788796970.586210:0:17210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fb38150d000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1788796970.586255:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fb488545800) 00010000:00010000:1.0:1788796970.586260:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788796970.586270:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4813d1600/0x500835b7bd265fc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5def7 expref: 10 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586315:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e2700) 00010000:00010000:1.0:1788796970.586318:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796970.586333:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb3881c5e00/0x500835b7bd265f40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5decd expref: 9 pid: 17222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586349:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fb4907bd000) 00010000:00010000:1.0:1788796970.586351:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788796970.586355:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29dc00/0x500835b7bd266146 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5df6e expref: 8 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586372:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fb386a2af00) 00010000:00010000:1.0:1788796970.586374:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796970.586378:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1a00/0x500835b7bd265f01 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5debf expref: 7 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586394:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fb4907bde00) 00010000:00010000:1.0:1788796970.586396:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796970.586400:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4be29d000/0x500835b7bd265ee5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5deb8 expref: 6 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586414:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fb4907bd400) 00010000:00010000:1.0:1788796970.586416:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796970.586420:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4813d0c00/0x500835b7bd2660eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5df59 expref: 5 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586431:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fb4907bd400) 00010000:00010000:1.0:1788796970.586434:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788796970.586437:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb3881c4400/0x500835b7bd2661af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5df98 expref: 4 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796970.586450:0:17210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fb38150d000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1788796970.586468:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796970.586470:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796970.586472:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796970.598579:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796970.600373:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593344 00000100:00100000:0.0:1788796970.600397:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593344 00000100:00100000:0.0:1788796970.600851:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 77 00000100:00100000:0.0:1788796970.600867:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+5:2407:x1875688963593344:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:0.0:1788796970.600914:0:18238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265e21 00000100:00080000:0.0:1788796970.600947:0:18238:0:(import.c:65:import_set_state_nolock()) ffff8fb38150c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788796970.600994:0:18238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788796970.601376:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85247cf7-c6b3-42ef-aa8e-1ad69122b44f+3:2407:x1875688963593344:12345-192.168.201.27@tcp:39:umount.0 Request processed in 512us (2822us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788796970.601387:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 77 00010000:00010000:3.0:1788796970.601569:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796970.772106:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984650752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796970.772211:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796970.772337:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650752 00000100:00100000:0.0:1788796970.772348:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650752 00000100:00100000:0.0:1788796970.772421:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788796970.772431:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984650752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796970.772472:0:18731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788796970.772534:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984650752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796970.772542:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788796970.773508:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984650752:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788796971.284313:0:17256:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788796971.284327:0:17256:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796971.284352:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788796971.284363:0:17256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788796971.285427:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.308300:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796972.452946:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788796972.453002:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788796972.453170:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593472 00000100:00100000:0.0:1788796972.453182:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593472 00000100:00100000:0.0:1788796972.453253:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593600 00000100:00100000:0.0:1788796972.453257:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593600 00000100:00100000:0.0:1788796972.453355:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:0.0:1788796972.453366:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+11:2409:x1875688963593472:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796972.453382:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796972.453402:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4c20e7c00/0x500835b7bd265e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5de3a expref: 11 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796972.453421:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796972.453474:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+10:2409:x1875688963593472:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 110us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796972.453481:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:0.0:1788796972.453497:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1788796972.453503:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+9:2408:x1875688963593600:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796972.453522:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796972.453541:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29c800/0x500835b7bd265e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5de6b expref: 9 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796972.453551:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796972.453568:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddedfdb3-02b5-437c-96fb-06bed3436b53+8:2408:x1875688963593600:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 65us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796972.453575:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1788796972.467784:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788796972.467964:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593984 00000100:00100000:3.0:1788796972.467975:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593984 00000100:00100000:3.0:1788796972.468049:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 78 00000100:00100000:3.0:1788796972.468061:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+6:2407:x1875688963593984:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:3.0:1788796972.468103:0:17220:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265e59 00000020:00010000:3.0:1788796972.468111:0:17220:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8fb4b9e91800: total 0 00000100:00080000:3.0:1788796972.468116:0:17220:0:(import.c:65:import_set_state_nolock()) ffff8fb4b9e95800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796972.468140:0:17220:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1788796972.468274:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2407:x1875688963593984:12345-192.168.201.27@tcp:39:umount.0 Request processed in 215us (498us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788796972.468281:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 78 00000020:00010000:3.0:1788796972.468303:0:17210:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8fb4b9e91800: total 0 00010000:00010000:3.0:1788796972.468306:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.468349:0:17210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fb4b9e91800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788796972.468380:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e2700) 00010000:00010000:3.0:1788796972.468384:0:17210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788796972.468391:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1c00/0x500835b7bd265f4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5ded4 expref: 4 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796972.468417:0:17210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fb4b9e91800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788796972.468426:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.468427:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.468429:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788796972.472106:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796972.473773:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796972.473829:0:20248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963593728 00000100:00100000:1.0:1788796972.473839:0:20248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963593728 00000100:00100000:1.0:1788796972.474181:0:20248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1788796972.474192:0:20248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddedfdb3-02b5-437c-96fb-06bed3436b53+8:2409:x1875688963593728:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796972.474208:0:20248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796972.474228:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd0400/0x500835b7bd265e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5deaa expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796972.474244:0:20248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796972.474289:0:20248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddedfdb3-02b5-437c-96fb-06bed3436b53+7:2409:x1875688963593728:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 100us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796972.474295:0:20248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1788796972.491739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788796972.491847:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594112 00000100:00100000:2.0:1788796972.491865:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594112 00000100:00100000:2.0:1788796972.491960:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 79 00000100:00100000:2.0:1788796972.491973:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+5:2407:x1875688963594112:12345-192.168.201.27@tcp:39:umount.0 00000020:00000080:2.0:1788796972.492021:0:17222:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265e60 00000100:00080000:2.0:1788796972.492031:0:17222:0:(import.c:65:import_set_state_nolock()) ffff8fb4b9e97000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796972.492097:0:17222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788796972.492254:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d+3:2407:x1875688963594112:12345-192.168.201.27@tcp:39:umount.0 Request processed in 284us (525us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788796972.492262:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 79 00010000:00010000:1.0:1788796972.493108:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796972.493720:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788796972.541471:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788796972.541624:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594368 00000100:00100000:1.0:1788796972.541636:0:17213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594368 00000100:00100000:1.0:1788796972.541727:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 176 00000100:00100000:1.0:1788796972.541738:0:17213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddedfdb3-02b5-437c-96fb-06bed3436b53+7:2407:x1875688963594368:12345-192.168.201.27@tcp:251:umount.0 00000020:00000080:1.0:1788796972.541785:0:17213:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265df7 00000020:00010000:1.0:1788796972.541793:0:17213:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8fb387564000: total 0 00000100:00080000:1.0:1788796972.541800:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8fb387562800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788796972.541875:0:17213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ddedfdb3-02b5-437c-96fb-06bed3436b53+3:2407:x1875688963594368:12345-192.168.201.27@tcp:251:umount.0 Request processed in 139us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796972.541905:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 176 00000020:00010000:3.0:1788796972.542195:0:17210:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8fb387564000: total 0 00010000:00010000:3.0:1788796972.542254:0:17210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fb387564000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788796972.542303:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c5000/0x500835b7bd265dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5ddc3 expref: 2 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796972.542320:0:17210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fb387564000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788796972.542329:0:17210:0:(genops.c:885:class_export_put()) final put ffff8fb387564000/ddedfdb3-02b5-437c-96fb-06bed3436b53 00010000:00010000:3.0:1788796972.542352:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.542354:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796972.542356:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796972.543275:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387564000/ddedfdb3-02b5-437c-96fb-06bed3436b53 for MGS 00000020:00000080:1.0:1788796972.543319:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb387562800 for MGS 00010000:00010000:1.0:1788796973.333630:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796973.857363:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796973.857391:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984650880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788796973.857612:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796973.885294:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984650880 00000100:00100000:0.0:1788796973.885313:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984650880 00000100:00100000:0.0:1788796973.885409:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788796973.885431:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984650880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788796973.885475:0:18731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788796973.885826:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984650880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 407us (28213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796973.885835:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788796973.885970:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984650880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788796973.886189:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796974.357368:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984651008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796974.357447:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.357532:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651008 00000100:00100000:3.0:1788796974.357541:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651008 00000100:00100000:3.0:1788796974.357598:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788796974.357608:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984651008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796974.357641:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788796974.357708:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984651008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.357714:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788796974.357739:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796974.357771:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984651008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796974.359233:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984651136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788796974.359287:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.359355:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651136 00000100:00100000:3.0:1788796974.359374:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651136 00000100:00100000:3.0:1788796974.359417:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788796974.359426:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984651136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788796974.359445:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788796974.359481:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984651136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.359487:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788796974.359516:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796974.359539:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984651136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788796974.361644:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984651264:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.361719:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796974.361752:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984651776:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.361775:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796974.361794:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984652288:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.361814:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.361977:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984651520:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362018:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.362038:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984652032:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362060:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.362076:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984652544:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362094:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.362115:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788796974.362120:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984651648:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362138:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.362152:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984652160:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362172:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.362195:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651520 00000100:00100000:3.0:1788796974.362202:0:18730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651520 00000100:00100000:3.0:1788796974.362250:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796974.362257:0:18730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984651520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362304:0:18730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984651520:12345-0@lo:400:kworker.0 Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362318:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796974.362354:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652288 00000100:00100000:3.0:1788796974.362358:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652288 00000100:00100000:3.0:1788796974.362380:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652032 00000100:00100000:3.0:1788796974.362383:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652032 00000100:00100000:3.0:1788796974.362398:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652544 00000100:00100000:3.0:1788796974.362400:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652544 00000100:00100000:3.0:1788796974.362415:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651648 00000100:00100000:3.0:1788796974.362417:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651648 00000100:00100000:3.0:1788796974.362430:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652160 00000100:00100000:3.0:1788796974.362433:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652160 00000100:00100000:3.0:1788796974.362449:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788796974.362454:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984652288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362484:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984652288:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362490:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788796974.362504:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788796974.362510:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984652032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362537:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984652032:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362543:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788796974.362557:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796974.362563:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984652544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362586:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875688984652544:12345-0@lo:400:kworker.0 Request processed in 23us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362591:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796974.362605:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788796974.362617:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984651648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362645:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984651648:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362651:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788796974.362665:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788796974.362672:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984652160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362717:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984652160:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.362722:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788796974.362751:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796974.362755:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788796974.362757:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796974.362783:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984651648:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362792:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984652160:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362802:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984651520:0@lo:400:kworker.0 00000100:00100000:3.0:1788796974.362811:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984652032:0@lo:400:kworker.0 00010000:00080000:3.0:1788796974.362823:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bacd5f80 x1875688984652544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796974.362833:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984652544:0@lo:400:kworker.0 00010000:00080000:0.0:1788796974.362984:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bacd6a00 x1875688984652288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796974.362994:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984652288:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363021:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788796974.363031:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984651392:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363058:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796974.363087:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984651904:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363107:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796974.363125:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984652416:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363142:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796974.363172:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651264 00000100:00100000:0.0:1788796974.363176:0:17215:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651264 00000100:00100000:0.0:1788796974.363206:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788796974.363212:0:17215:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3654:x1875688984651264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363246:0:17215:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3654:x1875688984651264:12345-0@lo:400:kworker.0 Request processed in 34us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796974.363252:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788796974.363280:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651776 00000100:00100000:0.0:1788796974.363284:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651776 00000100:00100000:0.0:1788796974.363307:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651392 00000100:00100000:0.0:1788796974.363310:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651392 00000100:00100000:0.0:1788796974.363321:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796974.363327:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984651776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363357:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984651776:12345-0@lo:400:kworker.0 Request processed in 30us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796974.363362:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796974.363372:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796974.363390:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984651392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363417:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984651392:12345-0@lo:400:kworker.0 Request processed in 40us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796974.363430:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796974.363448:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652416 00000100:00100000:0.0:1788796974.363452:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652416 00000100:00100000:0.0:1788796974.363481:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788796974.363487:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984652416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363515:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984652416:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796974.363520:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788796974.363541:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796974.363563:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984651392:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363572:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984652416:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363579:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984651264:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.363587:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984651776:0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.364197:0:18729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984651904 00000100:00100000:0.0:1788796974.364205:0:18729:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984651904 00000100:00100000:0.0:1788796974.364238:0:18729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788796974.364246:0:18729:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984651904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796974.364291:0:18729:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984651904:12345-0@lo:400:kworker.0 Request processed in 45us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796974.364297:0:18729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788796974.364334:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984651904:0@lo:400:kworker.0 00010000:00010000:1.0:1788796974.367453:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796974.868891:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796974.868919:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984652672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788796974.869003:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.869057:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652672 00000100:00100000:3.0:1788796974.869067:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652672 00000100:00100000:3.0:1788796974.869122:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788796974.869132:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984652672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788796974.869167:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788796974.869213:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984652672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.869219:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788796974.869270:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984652672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788796974.869569:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984652800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788796974.869599:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796974.869762:0:17961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652800 00000100:00100000:3.0:1788796974.869768:0:17961:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652800 00000100:00100000:3.0:1788796974.869804:0:17961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788796974.869811:0:17961:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984652800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788796974.869831:0:17961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788796974.869887:0:17961:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984652800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796974.869893:0:17961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788796974.869952:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984652800:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1788796974.986918:0:20794:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788796975.008812:0:20794:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788796975.008888:0:20794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.008903:0:20794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.008911:0:20794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.008917:0:20794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.008944:0:20794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796975.008949:0:20794:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788796975.009054:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796975.009064:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.009072:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c32800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788796975.009078:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.009088:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796975.009096:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796975.009134:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788796975.009137:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788796975.009140:0:17209:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788796975.009183:0:17209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.009190:0:17209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796975.009221:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.009230:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c32800/0x500835b7bd2659ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd2659c1 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.009242:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796975.009244:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796975.009245:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788796975.009352:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796975.009357:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788796975.009370:0:20794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788796975.009385:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb4bfa0d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788796975.009616:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984653056:0@lo:39:umount.0 00000100:00100000:3.0:1788796975.009715:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796975.009807:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653056 00000100:00100000:1.0:1788796975.009814:0:18238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653056 00000100:00100000:1.0:1788796975.009877:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788796975.009972:0:18238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875688984653056:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788796975.010001:0:18238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2659eb 00000100:00080000:1.0:1788796975.010010:0:18238:0:(import.c:65:import_set_state_nolock()) ffff8fb4a008d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788796975.010078:0:18238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3653:x1875688984653056:12345-0@lo:39:umount.0 Request processed in 109us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796975.010194:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3655:1875688984652928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796975.010247:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788796975.010659:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bfa0d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788796975.010812:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984653056:0@lo:39:umount.0 00000100:00100000:3.0:1788796975.010840:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984652928 00000100:00100000:3.0:1788796975.010846:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984652928 00000100:00100000:1.0:1788796975.011076:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1788796975.011095:0:18238:0:(genops.c:885:class_export_put()) final put ffff8fb497141000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788796975.011139:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796975.011152:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb497141000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788796975.011236:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4a008d800 for lustre-MDT0000 00000100:00100000:3.0:1788796975.011335:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796975.011346:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3655:x1875688984652928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796975.011362:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796975.011385:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c4a00/0x500835b7bd2659c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd2659ba expref: 24 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.011418:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796975.011490:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f06fb7a-06c9-40f6-936b-88b363d77b2c+23:3655:x1875688984652928:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.011498:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788796975.011601:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3655:1875688984652928:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788796975.011864:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796975.011868:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788796975.011873:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788796975.013314:0:20794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013330:0:20794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013337:0:20794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013345:0:20794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013374:0:20794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788796975.013379:0:20794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013386:0:20794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013393:0:20794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013399:0:20794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013409:0:20794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788796975.013416:0:20794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013421:0:20794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013439:0:20794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013445:0:20794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013453:0:20794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788796975.013459:0:20794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013465:0:20794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013471:0:20794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796975.013477:0:20794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013630:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788796975.013638:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013646:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c5a00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796975.013651:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013661:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796975.013668:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796975.013698:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788796975.013701:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788796975.013738:0:17209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013745:0:17209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796975.013773:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013781:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd26590b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265912 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013796:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796975.013799:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013804:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e000 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796975.013807:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013814:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796975.013821:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796975.013826:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788796975.013828:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788796975.013831:0:17209:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788796975.013860:0:17209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013867:0:17209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796975.013874:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013888:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb38682e000/0x500835b7bd265d1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d25 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013898:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796975.013902:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013907:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7400 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796975.013910:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013916:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796975.013922:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796975.013927:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788796975.013929:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788796975.013932:0:17209:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788796975.013945:0:17209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013951:0:17209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796975.013978:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.013990:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7400/0x500835b7bd265ec2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ec9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.014011:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796975.014013:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796975.014015:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796975.014036:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984653312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.014287:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796975.014527:0:20794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788796975.014532:0:20794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788796975.014535:0:20794:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788796975.014575:0:20794:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788796975.014579:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788796975.014584:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796975.014591:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788796975.014596:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8fb3882f9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788796975.014602:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8fb4aa0d6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788796975.014618:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8fb4886e6000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788796975.014623:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8fb385a68000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788796975.014631:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8fb4b9e91800 e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 192.168.201.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788796975.014636:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8fb38150d000 85247cf7-c6b3-42ef-aa8e-1ad69122b44f 192.168.201.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:0.0:1788796975.014640:0:20794:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8fb498b299b8) has exports, disconnecting them 00000020:00080000:0.0:1788796975.014644:0:20794:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fb3882f9800), last request at 1788796974 00000020:00000080:0.0:1788796975.014652:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265ced 00000100:00080000:0.0:1788796975.014669:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fd800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788796975.014729:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb3882f9800): rc 0 00000020:00000080:0.0:1788796975.014732:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb3882f9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788796975.014742:0:20794:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fb4aa0d6800), last request at 1788796974 00000020:00000080:0.0:1788796975.014745:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b88 00000100:00080000:0.0:1788796975.014750:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb388285800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788796975.014756:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb4aa0d6800): rc 0 00000020:00000080:0.0:1788796975.014758:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4aa0d6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788796975.014762:0:20794:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fb4886e6000), last request at 1788796887 00000020:00000080:0.0:1788796975.014764:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265ad9 00000100:00080000:0.0:1788796975.014768:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb4b8d1d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788796975.014773:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb4886e6000): rc 0 00000020:00000080:0.0:1788796975.014774:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4886e6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788796975.014777:0:20794:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fb385a68000), last request at 1788796887 00000020:00000080:0.0:1788796975.014780:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a70 00000100:00080000:0.0:1788796975.014784:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb4bad0e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788796975.014790:0:20794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:0.0:1788796975.014898:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb385a68000): rc 0 00000004:00000080:0.0:1788796975.014905:0:20794:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1ee082cbae0 00000100:00080000:0.0:1788796975.014936:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788796975.014940:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788796975.016763:0:20794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788796975.016811:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb38805a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788796975.017412:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788796975.017417:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788796975.017434:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788796975.017525:0:20794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788796975.017539:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb497147800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788796975.017547:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788796975.017549:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788796975.017558:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788796975.017626:0:20794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788796975.017632:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb486951000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788796975.017707:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8fb498b299b8) has no exports 00000100:00100000:1.0:1788796975.017936:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796975.017949:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984653184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.018143:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796975.018229:0:20248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653312 00000100:00100000:2.0:1788796975.018238:0:20248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653312 00000100:00100000:2.0:1788796975.018300:0:20248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796975.018310:0:20248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f06fb7a-06c9-40f6-936b-88b363d77b2c+23:3657:x1875688984653312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796975.018323:0:20248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796975.018343:0:20248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682ee00/0x500835b7bd265d25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265d1e expref: 23 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796975.018362:0:20248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796975.018395:0:20248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f06fb7a-06c9-40f6-936b-88b363d77b2c+22:3657:x1875688984653312:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796975.018402:0:20248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796975.018611:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653568:0@lo:39:umount.0 00000100:00100000:3.0:1788796975.018649:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796975.018702:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653696:0@lo:9:umount.0 00000100:00100000:3.0:1788796975.018724:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796975.018740:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653824:0@lo:9:umount.0 00000100:00100000:3.0:1788796975.018758:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796975.018865:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653696 00000100:00100000:3.0:1788796975.018870:0:18730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653696 00000100:00100000:3.0:1788796975.018908:0:18730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653824 00000100:00100000:3.0:1788796975.018912:0:18730:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653824 00000100:00100000:3.0:1788796975.018933:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796975.018940:0:18730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875688984653696:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788796975.019194:0:18730:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265bce 00000100:00080000:3.0:1788796975.019206:0:18730:0:(import.c:65:import_set_state_nolock()) ffff8fb388280000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796975.019251:0:18730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788796975.019381:0:18730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3653:x1875688984653696:12345-0@lo:9:umount.0 Request processed in 441us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.019388:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796975.019403:0:18730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788796975.019409:0:18730:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875688984653824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788796975.019421:0:18730:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265d2c 00000100:00080000:3.0:1788796975.019443:0:18730:0:(import.c:65:import_set_state_nolock()) ffff8fb387565000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796975.019461:0:18730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788796975.019623:0:18730:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3653:x1875688984653824:12345-0@lo:9:umount.0 Request processed in 214us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.019630:0:18730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788796975.019707:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb497147800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788796975.019720:0:3653:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788796975.019723:0:3653:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796975.019726:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653696:0@lo:9:umount.0 00000100:00080000:3.0:1788796975.019736:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb486951000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788796975.019742:0:3653:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788796975.019744:0:3653:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796975.019746:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653824:0@lo:9:umount.0 00000100:00100000:2.0:1788796975.019865:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653568 00000100:00100000:2.0:1788796975.019872:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653568 00000100:00100000:2.0:1788796975.019918:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788796975.019925:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875688984653568:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788796975.019944:0:17226:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b03 00000100:00080000:2.0:1788796975.019949:0:17226:0:(import.c:65:import_set_state_nolock()) ffff8fb4855f7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796975.020225:0:17226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788796975.020332:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3653:x1875688984653568:12345-0@lo:39:umount.0 Request processed in 407us (1681us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788796975.020339:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788796975.020491:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38805a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788796975.020498:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984653568:0@lo:39:umount.0 00000100:00100000:1.0:1788796975.020644:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984653312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.020671:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984653440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.020733:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788796975.020772:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882f9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788796975.020818:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4aa0d6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788796975.020836:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4886e6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788796975.020894:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb3882fd800 for lustre-MDT0000 00000020:00000080:1.0:1788796975.020900:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb388285800 for lustre-MDT0000 00000020:00000080:1.0:1788796975.020904:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4b8d1d800 for lustre-MDT0000 00010000:00010000:1.0:1788796975.020917:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796975.020927:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.020939:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796975.021061:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.021072:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796975.021079:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796975.021085:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788796975.021089:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788796975.021093:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788796975.021196:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.021203:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796975.021221:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.021228:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2658fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265904 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796975.021240:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796975.021241:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796975.021243:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796975.021251:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796975.021259:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984653952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.021285:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796975.021315:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796975.021386:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653184 00000100:00100000:3.0:1788796975.021394:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653184 00000100:00100000:3.0:1788796975.021426:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653440 00000100:00100000:3.0:1788796975.021429:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653440 00000100:00100000:3.0:1788796975.021438:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984653952 00000100:00100000:3.0:1788796975.021440:0:17206:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984653952 00000100:00100000:3.0:1788796975.021453:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788796975.021461:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+24:3657:x1875688984653184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796975.021472:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796975.021554:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb480031a00/0x500835b7bd265912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd26590b expref: 24 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.021568:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796975.021615:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+23:3657:x1875688984653184:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.021622:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788796975.021637:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796975.021643:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+22:3654:x1875688984653440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796975.021650:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796975.021659:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682fe00/0x500835b7bd265ec9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265ec2 expref: 22 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.021667:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796975.022350:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+21:3654:x1875688984653440:12345-0@lo:103:ldlm_bl.0 Request processed in 704us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.022357:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796975.022375:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788796975.022381:0:17206:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+20:3654:x1875688984653952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796975.022391:0:17206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796975.022401:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682f400/0x500835b7bd265904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd2658fd expref: 20 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796975.022410:0:17206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796975.022437:0:17206:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f06fb7a-06c9-40f6-936b-88b363d77b2c+19:3654:x1875688984653952:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796975.022442:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796975.022666:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984653952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.022675:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984653440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796975.022743:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984653184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788796975.031788:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8fb498b299b8) has no exports 00000020:00000080:2.0:1788796975.117239:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265958 00000020:00000080:2.0:1788796975.117260:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb488900800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788796975.117287:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788796975.117394:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796975.117408:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788796975.117413:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8fb4bd3c99b8) has no exports 00000020:00000080:1.0:1788796975.117441:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb488900800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788796975.118313:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265951 00000020:00000080:3.0:1788796975.118321:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb48c4f1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788796975.118405:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796975.118414:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788796975.118418:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4892ac000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788796975.118421:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4892ac000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788796975.118429:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788796975.118509:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb48c4f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788796975.381081:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796976.404778:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788796976.407776:0:18724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788796976.407787:0:18724:0:(genops.c:885:class_export_put()) final put ffff8fb388284800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788796976.407861:0:18724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:0.0:1788796976.407864:0:18724:0:(genops.c:885:class_export_put()) final put ffff8fb38150a800/85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:1.0:1788796976.408848:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388284800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788796976.408918:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb388280000 for lustre-OST0000 00000001:00100000:2.0:1788796976.409006:0:17201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788796976.409026:0:17201:0:(genops.c:885:class_export_put()) final put ffff8fb385a68000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788796976.409045:0:17201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000001:00080000:2.0:1788796976.409053:0:17201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1788796976.409057:0:17201:0:(genops.c:885:class_export_put()) final put ffff8fb4b9e91800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000001:00100000:2.0:1788796976.409062:0:17201:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000001:00080000:2.0:1788796976.409066:0:17201:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:2.0:1788796976.409068:0:17201:0:(genops.c:885:class_export_put()) final put ffff8fb38150d000/85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:1.0:1788796976.409120:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb385a68000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788796976.409157:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b9e91800/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d for lustre-MDT0000 00000020:00000080:1.0:1788796976.409184:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb38150d000/85247cf7-c6b3-42ef-aa8e-1ad69122b44f for lustre-MDT0000 00000020:00000080:1.0:1788796976.409327:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4bad0e800 for lustre-MDT0000 00000020:00000080:1.0:1788796976.409332:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4b9e95800 for lustre-MDT0000 00000020:00000080:1.0:1788796976.409335:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb381508800 for lustre-MDT0000 00000020:00000080:2.0:1788796976.409728:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb38150a800/85247cf7-c6b3-42ef-aa8e-1ad69122b44f for lustre-OST0000 00000020:00000080:2.0:1788796976.409768:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb38150e800 for lustre-OST0000 00000001:00100000:3.0:1788796976.409890:0:17953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788796976.409901:0:17953:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788796976.409904:0:17953:0:(genops.c:885:class_export_put()) final put ffff8fb4855f4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788796976.409954:0:17953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000001:00080000:3.0:1788796976.409959:0:17953:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788796976.409961:0:17953:0:(genops.c:885:class_export_put()) final put ffff8fb4b9e96000/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d 00000020:00000080:1.0:1788796976.409986:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4855f4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788796976.410029:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4855f7000 for lustre-MDT0001 00000001:00100000:3.0:1788796976.410133:0:17953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000001:00080000:3.0:1788796976.410139:0:17953:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788796976.410141:0:17953:0:(genops.c:885:class_export_put()) final put ffff8fb38150b800/85247cf7-c6b3-42ef-aa8e-1ad69122b44f 00000020:00000080:2.0:1788796976.410161:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b9e96000/e1c86ba8-d12a-4cbb-bd9e-96c50e015a1d for lustre-MDT0001 00000020:00000080:2.0:1788796976.410269:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4b9e97000 for lustre-MDT0001 00000020:00000080:1.0:1788796976.410440:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb38150b800/85247cf7-c6b3-42ef-aa8e-1ad69122b44f for lustre-MDT0001 00000020:00000080:1.0:1788796976.410711:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb38150c000 for lustre-MDT0001 00000020:01000000:3.0:1788796977.171910:0:20794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb3889902a0 - data ffff8fb4aa844af8/ffff8fb4856ae800 00000020:01000000:3.0:1788796977.172078:0:20794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb48610d120 - data ffff8fb489ce8bd0/ffff8fb4be296c00 00000001:00000004:3.0:1788796977.180075:0:20794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788796977.208419:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788796977.208429:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788796977.208506:0:20794:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8fb4bacd6d80 x1875688984653568/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788796985 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796977.208535:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788796977.212202:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788796977.212210:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788796977.212275:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796977.212278:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788796977.215435:0:17244:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788796977.215443:0:17244:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788796977.215455:0:17244:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788796977.216331:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788796977.216337:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788796977.216388:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796977.216391:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788796977.221609:0:17246:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788796977.221616:0:17246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788796977.221628:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788796977.224471:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265920 00000020:00000080:0.0:1788796977.224577:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb387959000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788796977.225664:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387959000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788796977.227746:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265935 00000020:00000080:0.0:1788796977.227760:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4bd1b7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788796977.227770:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788796977.227774:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796977.227783:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788796977.227788:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8fb498b2cd28) has no exports 00000020:00000080:1.0:1788796977.227825:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bd1b7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788796977.228017:0:20794:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788796977.228027:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265997 00000020:00000080:0.0:1788796977.228031:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb486952000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788796977.228045:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788796977.228049:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796977.228054:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788796977.228057:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8fb498b28000) has no exports 00000020:00000080:0.0:1788796977.228064:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265990 00000020:00000080:0.0:1788796977.228069:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb486950800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788796977.228124:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb486952000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788796977.228135:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb486950800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788796977.228903:0:20794:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788796977.228908:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788796977.228913:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788796977.228919:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788796977.228922:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788796977.228972:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796977.228980:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788796977.228986:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265982 00000020:00000080:0.0:1788796977.228993:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb497146800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788796977.228998:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788796977.229001:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796977.229004:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788796977.229007:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8fb4bd3cb370) has no exports 00000020:00000080:0.0:1788796977.229011:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd26597b 00000020:00000080:0.0:1788796977.229015:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb497140800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788796977.229786:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb486951000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788796977.229798:0:505:0:(genops.c:885:class_export_put()) final put ffff8fb497144800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788796977.229822:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb497144800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788796977.229829:0:505:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788796977.229929:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb497146800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788796977.229935:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb497140800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788796977.230859:0:20794:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788796977.230864:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788796977.230868:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788796977.230878:0:20794:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788796977.230880:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796977.230972:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb497147800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788796977.231037:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796977.231046:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788796977.231051:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb497146000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788796977.231062:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb497146000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788796977.231068:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788796977.231280:0:20794:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788796977.231288:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd26596d 00000020:00000080:0.0:1788796977.231294:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb48821c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788796977.231301:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788796977.231315:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796977.231320:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788796977.231323:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8fb3878ab370) has no exports 00000020:00000080:1.0:1788796977.231411:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb48821c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788796977.231511:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265966 00000020:00000080:0.0:1788796977.231518:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb388059800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788796977.231642:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388059800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788796977.233799:0:20794:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788796977.233808:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788796977.233821:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788796977.233830:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796977.233894:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.233907:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788796977.233955:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.233978:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788796977.234019:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb387959800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788796977.234023:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387959800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788796977.234031:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788796977.234129:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd26593c 00000020:00000080:1.0:1788796977.234135:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4bd1b6000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788796977.234140:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788796977.234144:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796977.234158:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788796977.234162:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8fb498b2b370) has no exports 00000020:00000080:1.0:1788796977.234182:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.234186:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788796977.234190:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265943 00000020:00000080:1.0:1788796977.234194:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4bd1b3000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788796977.234203:0:20794:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb3868d5000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788796977.234216:0:20794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb3868d5000 3 00000020:01000004:1.0:1788796977.234219:0:20794:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fb3868d5000 from lustre-MDT0000 00000020:00000080:1.0:1788796977.234236:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.234240:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788796977.234242:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb387958000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788796977.234244:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387958000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788796977.234250:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788796977.234278:0:20794:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788796977.234282:0:20794:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788796977.234285:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788796977.234288:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796977.234290:0:20794:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788796977.234296:0:20794:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8fb388151000 2f06fb7a-06c9-40f6-936b-88b363d77b2c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796977.234301:0:20794:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8fb4bd3ccd28) has exports, disconnecting them 00000020:00080000:1.0:1788796977.234305:0:20794:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8fb388151000), last request at 1788796868 00000020:00000080:1.0:1788796977.234435:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2658e8 00000020:00010000:1.0:1788796977.234439:0:20794:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8fb388151000: total 2 00000100:00080000:1.0:1788796977.234454:0:20794:0:(import.c:65:import_set_state_nolock()) ffff8fb388154800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788796977.234467:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb388151000): rc 0 00000020:00080000:1.0:1788796977.234471:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8fb4bd3ccd28) has no exports 00000020:00010000:1.0:1788796977.234481:0:17210:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8fb388151000: total 2 00010000:00010000:1.0:1788796977.234484:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796977.234507:0:17210:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fb388151000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788796977.234537:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682fc00/0x500835b7bd2658f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd2658ef expref: 14 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234555:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c5c00/0x500835b7bd265a07 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265a00 expref: 13 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234570:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682ec00/0x500835b7bd265b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265b6c expref: 12 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234595:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd265e9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265e98 expref: 11 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234606:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb483c32600/0x500835b7bd265ac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265abd expref: 10 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234616:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682e600/0x500835b7bd265a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265a0e expref: 9 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234628:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd0e00/0x500835b7bd265ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265ea6 expref: 8 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234638:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c5800/0x500835b7bd265a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265a1c expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234647:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd0600/0x500835b7bd265ebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265eb4 expref: 6 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234658:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb480030200/0x500835b7bd265cae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265ca7 expref: 5 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234667:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682ea00/0x500835b7bd265cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265cd1 expref: 4 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234677:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb480031000/0x500835b7bd265d17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265d10 expref: 3 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234711:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb483c32a00/0x500835b7bd265b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x500835b7bd265b42 expref: 2 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796977.234734:0:17210:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fb388151000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788796977.234747:0:17210:0:(genops.c:885:class_export_put()) final put ffff8fb388151000/2f06fb7a-06c9-40f6-936b-88b363d77b2c 00010000:00010000:1.0:1788796977.234752:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796977.234754:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796977.234755:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796977.236782:0:17215:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8fb48361f600:17215] 1 exiting: rc = 0 00000020:00000080:2.0:1788796977.238876:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb38805a800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788796977.238893:0:505:0:(genops.c:885:class_export_put()) final put ffff8fb388058000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788796977.238897:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388058000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788796977.238913:0:505:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788796977.239032:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bd1b6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788796977.239048:0:505:0:(genops.c:885:class_export_put()) final put ffff8fb4bd1b2000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788796977.239051:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bd1b2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788796977.239055:0:505:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788796977.239094:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bd1b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788796977.239099:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388151000/2f06fb7a-06c9-40f6-936b-88b363d77b2c for MGS 00000020:00000080:2.0:1788796977.239173:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb388154800 for MGS 00000100:00100000:2.0:1788796977.239227:0:17216:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8fb48361e000:17216] 2 exiting: rc = 0 00000100:00100000:1.0:1788796977.241067:0:17213:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8fb48361ec00:17213] 0 exiting: rc = 1 00000100:00100000:2.0:1788796977.241487:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241497:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241503:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241510:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241516:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241523:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241530:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241536:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241543:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241549:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241557:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241563:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241570:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241576:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241582:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241588:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241595:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241602:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241609:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241615:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241621:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241626:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241633:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241639:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241646:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241654:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241711:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241719:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241725:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241732:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241738:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241744:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241751:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241758:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241764:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241769:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241776:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241781:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241787:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241793:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241799:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241804:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241810:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241826:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241832:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241837:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241842:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241847:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241852:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241857:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241862:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241868:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241873:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241878:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241883:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241888:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241893:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241898:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241904:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241909:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241914:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241928:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241934:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796977.241940:0:20794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788796977.248937:0:20794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb38189d540 - data ffff8fb4aaa67288/ffff8fb387783400 00000020:01000000:2.0:1788796977.249598:0:20794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb3818cc6c0 - data ffff8fb385c0e438/ffff8fb4bdb0d800 00000020:00000080:2.0:1788796977.250880:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2658cc 00000020:00000080:2.0:1788796977.250892:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb388155800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788796977.251081:0:20794:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb3868d5000 from MGS, refs=2 00000020:01000004:2.0:1788796977.251085:0:20794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb3868d5000 2 00000020:01000004:2.0:1788796977.251089:0:20794:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fb3868d5000 from MGS 00000020:00000080:2.0:1788796977.251114:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796977.251122:0:20794:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788796977.251126:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb388156000/MGS 00000020:00000080:2.0:1788796977.251129:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388156000/MGS for MGS 00000020:01000000:2.0:1788796977.251137:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788796977.251565:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788796977.251570:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796977.251577:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788796977.251583:0:20794:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8fb4bfa0f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788796977.251589:0:20794:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8fb4bd3c8000) has exports, disconnecting them 00000020:00080000:2.0:1788796977.251595:0:20794:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8fb4bfa0f000), last request at 1788796869 00000020:00000080:2.0:1788796977.251599:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2659cf 00000020:00080000:2.0:1788796977.251611:0:20794:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb4bfa0f000): rc 0 00000020:00000080:2.0:1788796977.251616:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4bfa0f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788796977.254490:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388155800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788796977.255035:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfa0f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788796977.259514:0:20794:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788796977.259523:0:20794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796977.259527:0:20794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788796977.259536:0:20794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796977.259567:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4bfa0d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788796977.259803:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.259827:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788796977.259833:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb4bfa09000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788796977.259838:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfa09000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788796977.259844:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788796977.259936:0:20794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb3868d5000 1 00000020:00000080:1.0:1788796977.259942:0:20794:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2658be 00000020:00000080:1.0:1788796977.259948:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb388153000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788796977.259957:0:20794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788796977.259964:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388153000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788796977.259977:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796977.259981:0:20794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788796977.259985:0:20794:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8fb4bfa2cd28) has no exports 00000020:00000080:1.0:1788796977.290991:0:20794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796977.291013:0:20794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788796977.291019:0:20794:0:(genops.c:885:class_export_put()) final put ffff8fb3868d6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788796977.291024:0:20794:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3868d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788796977.291036:0:20794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788796977.291218:0:20794:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fb3868d4000 00000020:02000400:1.0:1788796977.291288:0:20794:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788796977.430582:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796978.454812:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796978.964185:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984654080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788796978.964264:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796978.964996:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654080 00000100:00100000:1.0:1788796978.965010:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654080 00000100:00100000:1.0:1788796978.965098:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796978.965111:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984654080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788796978.965149:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788796978.965224:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984654080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796978.965232:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788796978.965383:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984654080:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788796978.965551:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788796979.479170:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796979.480397:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984654336:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.480467:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.480551:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984654464:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.480576:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.480648:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984654848:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.480673:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.480737:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984654976:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.480760:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796979.480951:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984654208:0@lo:400:kworker.0 00000400:00000100:0.0:1788796979.480976:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875688984654208 offset 0 length 224: 4 00000100:00100000:0.0:1788796979.480994:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984654720:0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481015:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796979.481040:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984655232:0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481058:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796979.481077:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788796979.481082:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984654592:0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481101:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796979.481118:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984655104:0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481137:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796979.481172:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654848 00000100:00100000:0.0:1788796979.481180:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654848 00000100:00100000:0.0:1788796979.481222:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654976 00000100:00100000:0.0:1788796979.481225:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654976 00000100:00100000:0.0:1788796979.481255:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654720 00000100:00100000:0.0:1788796979.481258:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654720 00000100:00100000:0.0:1788796979.481266:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655232 00000100:00100000:0.0:1788796979.481268:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655232 00000100:00100000:0.0:1788796979.481281:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655104 00000100:00100000:0.0:1788796979.481283:0:17222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655104 00000100:00100000:0.0:1788796979.481295:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788796979.481303:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984654976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481356:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984654976:12345-0@lo:400:kworker.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796979.481363:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788796979.481385:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788796979.481392:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984655232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796979.481422:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984655232:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796979.481428:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788796979.481443:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796979.481447:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875688984654848:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788796979.481452:0:17222:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788796979.481480:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875688984654848:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788796979.481485:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796979.481501:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796979.481504:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875688984654720:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788796979.481508:0:17222:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788796979.481528:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875688984654720:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788796979.481540:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796979.481554:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788796979.481557:0:17222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875688984655104:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788796979.481562:0:17222:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788796979.481582:0:17222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875688984655104:12345-0@lo:400:kworker.0 Request processed in 23us (444us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788796979.481587:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788796979.481610:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788796979.481635:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8fb4b9ecbb80 x1875688984654976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796979.481650:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984654976:0@lo:400:kworker.0 00000100:00080000:0.0:1788796979.481676:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788796979.481704:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb387634800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788796979.481708:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788796979.484165:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654336 00000100:00100000:2.0:1788796979.484182:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654336 00000100:00100000:2.0:1788796979.484235:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788796979.484242:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875688984654336:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788796979.484250:0:17225:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788796979.484362:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875688984654336:12345-0@lo:400:kworker.0 Request processed in 119us (3894us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788796979.484370:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788796979.484444:0:18728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654464 00000100:00100000:2.0:1788796979.484450:0:18728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654464 00000100:00100000:2.0:1788796979.484479:0:18728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984654592 00000100:00100000:2.0:1788796979.484482:0:18728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984654592 00000100:00100000:2.0:1788796979.484514:0:18728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788796979.484521:0:18728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984654464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796979.484569:0:18728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984654464:12345-0@lo:400:kworker.0 Request processed in 48us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796979.484575:0:18728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788796979.484585:0:18728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788796979.484591:0:18728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984654592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796979.484617:0:18728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984654592:12345-0@lo:400:kworker.0 Request processed in 27us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796979.484622:0:18728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788796979.484639:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788796979.484675:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984654464:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.497520:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984654592:0@lo:400:kworker.0 00000100:00080000:1.0:1788796979.497541:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788796979.497568:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788796979.497573:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788796979.497579:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788796979.497584:0:3657:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1788796979.497598:0:3657:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fb3882fa000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788796979.497638:0:3657:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ece300 x1875688984655360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796979.497671:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984655104:0@lo:400:kworker.0 00000100:00080000:1.0:1788796979.497704:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788796979.497707:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8fb4b165d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788796979.497710:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788796979.497713:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8fb4b165d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788796979.497716:0:3657:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 603 00000100:00080000:1.0:1788796979.497721:0:3657:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8fb4b165d000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788796979.497733:0:3657:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecc000 x1875688984655488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796979.497743:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984654720:0@lo:400:kworker.0 00010000:00080000:1.0:1788796979.497759:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8fb4b9ecd500 x1875688984655232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796979.497768:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984655232:0@lo:400:kworker.0 00000100:00100000:2.0:1788796979.497955:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984655360:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788796979.498025:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796979.498060:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875688984655488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788796979.498081:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796979.498135:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655360 00000100:00100000:2.0:1788796979.498142:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655360 00000100:00100000:2.0:1788796979.498178:0:17221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655488 00000100:00100000:2.0:1788796979.498181:0:17221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655488 00000100:00100000:2.0:1788796979.498214:0:17221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788796979.498221:0:17221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1875688984655360:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788796979.498241:0:17221:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788796979.503221:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788796979.503236:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984655488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788796979.503297:0:17220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788796979.503391:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984655488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 157us (5308us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788796979.503399:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788796979.503866:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4b165d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788796979.503873:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788796979.503877:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875688984655488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788796979.504193:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796979.504209:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984655616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788796979.504254:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.506017:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655616 00000100:00100000:1.0:1788796979.506030:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655616 00000100:00100000:1.0:1788796979.506094:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788796979.506104:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984655616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788796979.506135:0:18732:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788796979.506204:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984655616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796979.506211:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788796979.512055:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984655616:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788796979.542434:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb387634800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796979.542444:0:3654:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 621 00000100:00080000:0.0:1788796979.542461:0:3654:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fb387634800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788796979.542508:0:3654:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd7480 x1875688984655744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796979.542548:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984654848:0@lo:400:kworker.0 00000100:00080000:0.0:1788796979.542579:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788796979.542584:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb385a6e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788796979.542587:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788796979.542600:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb385a6e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796979.542605:0:3654:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1788796979.542611:0:3654:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8fb385a6e800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788796979.542626:0:3654:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd6680 x1875688984655872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796979.542637:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984654336:0@lo:400:kworker.0 00000100:00100000:1.0:1788796979.542742:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984655744:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788796979.542826:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.542857:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984655872:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788796979.542883:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796979.542931:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655744 00000100:00100000:1.0:1788796979.542938:0:17220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655744 00000100:00100000:1.0:1788796979.542976:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788796979.542984:0:17220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984655744:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788796979.543005:0:17220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788796979.543048:0:17220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984655744:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788796979.543055:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788796979.543090:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb387634800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796979.543102:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788796979.543105:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984655744:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788796979.581267:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984655872 00000100:00100000:3.0:1788796979.581287:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984655872 00000100:00100000:3.0:1788796979.581355:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788796979.581377:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984655872:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788796979.581401:0:17226:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788796979.581494:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984655872:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 117us (38608us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788796979.581501:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788796979.581647:0:17221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1875688984655360:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 83424us (83620us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788796979.581658:0:17221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788796979.585887:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a6e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796979.585899:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788796979.585904:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984655872:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788796979.585917:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796979.585920:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788796979.585923:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984655360:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:2.0:1788796979.735967:0:17973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788796980.505993:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788796981.013262:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788796981.013275:0:19542:0:(genops.c:885:class_export_put()) final put ffff8fb387561000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796981.013384:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387561000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788796981.013424:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb387565000 for lustre-OST0001 00010000:00010000:2.0:1788796981.535647:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788796981.915311:0:20995:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788796981.944164:0:20995:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788796981.944219:0:20995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.944233:0:20995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.944240:0:20995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.944247:0:20995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.944307:0:20995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796981.944313:0:20995:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788796981.944335:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796981.944352:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788796981.944358:0:20995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788796981.944374:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb4b165d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788796981.944380:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796981.944381:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788796981.944384:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788796981.945285:0:20995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.945296:0:20995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.945303:0:20995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.945309:0:20995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945568:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796981.945576:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945583:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f200 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:2.0:1788796981.945587:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945596:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796981.945603:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796981.945608:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788796981.945612:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788796981.945614:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788796981.945650:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945656:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796981.945708:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945724:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb38682f200/0x500835b7bd265abd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265ac4 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945751:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796981.945754:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945759:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c33600 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:2.0:1788796981.945762:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945768:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796981.945774:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796981.945778:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788796981.945780:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788796981.945791:0:17210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945797:0:17210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796981.945813:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.945820:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796981.945822:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796981.945823:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796981.945851:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3656:1875688984656128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796981.945917:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796981.946012:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796981.946021:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb488ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984656000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788796981.946045:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796981.946149:0:20248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984656128 00000100:00100000:2.0:1788796981.946156:0:20248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984656128 00000100:00100000:2.0:1788796981.946192:0:20248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984656000 00000100:00100000:2.0:1788796981.946196:0:20248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984656000 00000100:00100000:2.0:1788796981.946211:0:20248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788796981.946218:0:20248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3656:x1875688984656128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788796981.946224:0:20248:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788796981 with bad export cookie 5766918386116614376 00000100:00100000:0.0:1788796981.946546:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796981.946552:0:17208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1875688984656000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788796981.946557:0:17208:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788796981 with bad export cookie 5766918386116614376 00000100:00100000:0.0:1788796981.946599:0:17208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1875688984656000:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (552us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788796981.946606:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788796981.946638:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788796981.946642:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb4846f1800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788796981.946645:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788796981.949514:0:20995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788796981.949527:0:20995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33600/0x500835b7bd265a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265a23 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.949563:0:20995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.949570:0:20995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.949577:0:20995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.949605:0:20995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.952487:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796981.952504:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.952516:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c33000 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788796981.952520:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.952531:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796981.952539:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796981.952545:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788796981.952547:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:2.0:1788796981.953064:0:20248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3656:x1875688984656128:12345-0@lo:103:ldlm_bl.0 Request processed in 6841us (7143us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788796981.953078:0:20248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788796981.953144:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1788796981.953203:0:20995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788796981.953210:0:20995:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788796981.953243:0:20995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953253:0:20995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953260:0:20995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953267:0:20995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953278:0:20995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796981.953283:0:20995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953290:0:20995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953295:0:20995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953302:0:20995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796981.953325:0:20995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788796981.953329:0:20995:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788796981.953332:0:20995:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788796981.954473:0:20995:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788796981.954479:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788796981.954486:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796981.954493:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788796981.954499:0:20995:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8fb3882f8800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796981.954506:0:20995:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8fb388280800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796981.954511:0:20995:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8fb4bbe5cd28) has exports, disconnecting them 00000020:00080000:1.0:1788796981.954515:0:20995:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8fb3882f8800), last request at 1788796979 00000020:00000080:1.0:1788796981.954522:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265d02 00000100:00080000:1.0:1788796981.954541:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb38150c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788796981.954590:0:20995:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb3882f8800): rc 0 00000020:00000080:1.0:1788796981.954592:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb3882f8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788796981.954607:0:20995:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8fb388280800), last request at 1788796979 00000020:00000080:1.0:1788796981.954610:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b9d 00000100:00080000:1.0:1788796981.954615:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb388283800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788796981.954621:0:20995:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb388280800): rc 0 00000020:00000080:1.0:1788796981.954623:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb388280800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788796981.954630:0:20995:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb1ee014abae0 00000100:00080000:1.0:1788796981.954649:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796981.954652:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788796981.955462:0:20995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788796981.955468:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb385a6e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788796981.955979:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788796981.955982:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788796981.956006:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788796981.956079:0:20995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788796981.956101:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb4a0792000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788796981.956114:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788796981.956116:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788796981.956124:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788796981.956196:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984656256:0@lo:9:umount.0 00000100:00100000:1.0:1788796981.956255:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788796981.956313:0:20995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788796981.956322:0:20995:0:(import.c:65:import_set_state_nolock()) ffff8fb4bfa31000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788796981.956336:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984656384:0@lo:9:umount.0 00000100:00100000:1.0:1788796981.957442:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788796981.957530:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8fb4bbe5cd28) has no exports 00000100:00080000:0.0:1788796981.964675:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.127@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788796981.964800:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788796981.964811:0:3654:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4b9ec8380 x1875688984654208/t0(0) o400->MGC192.168.201.127@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788796995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796981.964902:0:3654:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb387b92300 x1875688984656128/t0(0) o103->MGC192.168.201.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788796997 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796981.964913:0:3654:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb488ad4700 x1875688984656000/t0(0) o103->MGC192.168.201.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788796997 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796981.964975:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3657:1875688984654208:0@lo:400:kworker.0 10000000:01000000:0.0:1788796981.965031:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788796981.965035:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788796981.965036:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788796981.965040:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8fb4846f1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796981.965045:0:3654:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1788796981.965056:0:3654:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import ffff8fb4846f1800 using connection 192.168.201.127@tcp/0@lo 00000100:00080000:2.0:1788796981.965150:0:3656:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8fb4846f1800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788796981.965170:0:3654:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecc380 x1875688984656512/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788796981.965182:0:18728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984656256 00000100:00100000:2.0:1788796981.965190:0:18728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984656256 00000100:00100000:1.0:1788796981.965196:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb488ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3654:1875688984656000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796981.965245:0:18728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984656384 00000100:00100000:2.0:1788796981.965249:0:18728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984656384 00000100:00100000:2.0:1788796981.965273:0:18728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788796981.965282:0:18728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875688984656256:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788796981.965320:0:18728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265bc7 00000100:00080000:2.0:1788796981.965329:0:18728:0:(import.c:65:import_set_state_nolock()) ffff8fb387635000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796981.965366:0:18728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788796981.965528:0:18728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3653:x1875688984656256:12345-0@lo:9:umount.0 Request processed in 246us (9271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796981.965536:0:18728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788796981.965552:0:18728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788796981.965559:0:18728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875688984656384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788796981.965578:0:18728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265d33 00000100:00080000:2.0:1788796981.965583:0:18728:0:(import.c:65:import_set_state_nolock()) ffff8fb4bad86000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796981.965600:0:18728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788796981.965671:0:18728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3653:x1875688984656384:12345-0@lo:9:umount.0 Request processed in 113us (9313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796981.965677:0:18728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788796981.966088:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796981.966092:0:17217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796981.966110:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788796981.966199:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3656:1875688984656128:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788796981.966261:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882f8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:1.0:1788796981.966270:0:20996:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:2.0:1788796981.966305:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388280800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788796981.966326:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb38150c800 for lustre-MDT0001 00000020:00000080:2.0:1788796981.966330:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb388283800 for lustre-MDT0001 00010000:00010000:2.0:1788796981.966426:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.966436:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4600 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:2.0:1788796981.966441:0:17210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.966451:0:17210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796981.966459:0:17210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796981.966465:0:17210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788796981.966473:0:17210:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788796981.966476:0:17210:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788796981.966489:0:17210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:2.0:1788796981.966493:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.966500:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd265eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265ebb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796981.966511:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796981.966512:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796981.966514:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796981.966603:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3653:1875688984656512:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788796981.966639:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875688984656512 offset 0 length 520: 4 00000100:00080000:0.0:1788796981.966708:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bfa31000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788796981.966720:0:3653:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788796981.966722:0:3653:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788796981.966725:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984656384:0@lo:9:umount.0 00000100:00080000:0.0:1788796981.966749:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4a0792000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788796981.966760:0:3653:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788796981.966761:0:3653:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788796981.966764:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984656256:0@lo:9:umount.0 00010000:00010000:1.0:1788796981.967202:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796981.967205:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796981.967207:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796981.967250:0:20996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796981.967258:0:20996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c33c00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:0.0:1788796981.967261:0:20996:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796981.967269:0:20996:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796981.967276:0:20996:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796981.967301:0:20996:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796981.967303:0:20996:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788796981.967306:0:20996:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788796981.967313:0:20996:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:0.0:1788796981.967316:0:20996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796981.967323:0:20996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33c00/0x500835b7bd265a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265a15 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796981.967338:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796981.967340:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796981.967341:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796981.968654:0:17209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.968666:0:17209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788796981.968859:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2f06fb7a-06c9-40f6-936b-88b363d77b2c:0:1875688984656640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796981.968920:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.968942:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33000/0x500835b7bd265d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x500835b7bd265d17 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796981.968960:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796981.968962:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796981.968964:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788796981.978056:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8fb4bbe5cd28) has no exports 00000020:01000000:0.0:1788796982.055526:0:20995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb388990a80 - data ffff8fb4aab3ca20/ffff8fb4856ae400 00000020:01000000:0.0:1788796982.055769:0:20995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb3869e9ba0 - data ffff8fb489ce9870/ffff8fb485602c00 00000001:00000004:1.0:1788796982.070983:0:20995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788796982.129141:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788796982.129150:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788796982.129166:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788796982.133556:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788796982.133563:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788796982.133574:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796982.133577:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788796982.134026:0:17962:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788796982.134031:0:17962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788796982.134050:0:17962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788796982.134876:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788796982.134881:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788796982.134897:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796982.134899:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788796982.138267:0:17964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788796982.138284:0:17964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788796982.138299:0:17964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788796982.139960:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a31 00000020:00000080:2.0:1788796982.139971:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4bfad3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788796982.141255:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfad3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788796982.143577:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a46 00000020:00000080:2.0:1788796982.143593:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b8d1b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788796982.143609:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788796982.143617:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796982.143626:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788796982.143631:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8fb4bbe5b370) has no exports 00000004:01000000:2.0:1788796982.143859:0:20995:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788796982.143867:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a9a 00000020:00000080:2.0:1788796982.143872:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4855f3800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788796982.143875:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788796982.143888:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796982.143892:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788796982.143894:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8fb4bab699b8) has no exports 00000020:00000080:2.0:1788796982.143900:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a93 00000020:00000080:2.0:1788796982.143904:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4bfa30000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788796982.144222:0:20995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788796982.144227:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788796982.144231:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788796982.144236:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796982.144239:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788796982.144266:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796982.144271:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788796982.144276:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a85 00000020:00000080:2.0:1788796982.144280:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b8d1a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788796982.144282:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788796982.144285:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796982.144287:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788796982.144289:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8fb4980e4d28) has no exports 00000020:00000080:2.0:1788796982.144292:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a7e 00000020:00000080:2.0:1788796982.144295:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b165a000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788796982.144616:0:20995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788796982.144619:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788796982.144621:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788796982.144624:0:20995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788796982.144625:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788796982.144646:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796982.144649:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788796982.144658:0:20995:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788796982.144661:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a69 00000020:00000080:2.0:1788796982.144665:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b165b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788796982.144668:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788796982.144671:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796982.144678:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788796982.144704:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8fb4bfa2b370) has no exports 00000020:00000080:2.0:1788796982.144708:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a62 00000020:00000080:2.0:1788796982.144710:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb385a6f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788796982.145500:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b8d1b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788796982.145511:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4855f3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788796982.145516:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfa30000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788796982.145521:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4bfa31000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788796982.145527:0:38:0:(genops.c:885:class_export_put()) final put ffff8fb385a6d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788796982.145529:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb385a6d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788796982.145533:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788796982.145612:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b8d1a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788796982.145617:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b165a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788796982.145620:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4a0792000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788796982.145623:0:38:0:(genops.c:885:class_export_put()) final put ffff8fb4b165e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788796982.145625:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b165e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788796982.145628:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788796982.145653:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b165b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788796982.145656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb385a6f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788796982.153766:0:20995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788796982.153789:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788796982.153793:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788796982.153801:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788796982.153868:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796982.153879:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788796982.153935:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796982.153937:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788796982.153942:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb387921000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788796982.153947:0:20995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387921000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788796982.153958:0:20995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788796982.154112:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a4d 00000020:00000080:3.0:1788796982.154120:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b8d1a000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788796982.154124:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788796982.154128:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796982.154132:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788796982.154136:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8fb4bbe599b8) has no exports 00000020:00000080:3.0:1788796982.154176:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796982.154180:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788796982.154183:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265a54 00000020:00000080:3.0:1788796982.154186:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b8d1e800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788796982.154193:0:20995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb38805f800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788796982.154195:0:20995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb38805f800 2 00000020:01000004:3.0:1788796982.154198:0:20995:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fb38805f800 from lustre-MDT0001 00000020:00000080:3.0:1788796982.154217:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796982.154219:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788796982.154221:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4bfad2800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788796982.154223:0:20995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfad2800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788796982.154231:0:20995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788796982.154254:0:20995:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788796982.154258:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788796982.154260:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796982.154263:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788796982.154283:0:20995:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8fb4b1659800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788796982.154288:0:20995:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8fb4bbe58000) has exports, disconnecting them 00000020:00080000:3.0:1788796982.154293:0:20995:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8fb4b1659800), last request at 1788796887 00000020:00000080:3.0:1788796982.154297:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265ad2 00000020:00080000:3.0:1788796982.154309:0:20995:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb4b1659800): rc 0 00000020:00000080:3.0:1788796982.154312:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b1659800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788796982.155070:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb385a6e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788796982.155085:0:38:0:(genops.c:885:class_export_put()) final put ffff8fb4886e1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788796982.155087:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4886e1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788796982.155097:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788796982.155196:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b8d1a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788796982.155200:0:38:0:(genops.c:885:class_export_put()) final put ffff8fb4bfad2000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788796982.155201:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfad2000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788796982.155205:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788796982.155340:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b8d1e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788796982.155345:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b1659800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788796982.170762:0:20995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788796982.170773:0:20995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796982.170777:0:20995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788796982.170784:0:20995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796982.170815:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4b165d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788796982.171026:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796982.171036:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788796982.171042:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4b8d1e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788796982.171046:0:20995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4b8d1e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788796982.171053:0:20995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788796982.171121:0:20995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb38805f800 1 00000020:00000080:1.0:1788796982.171127:0:20995:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2659f9 00000020:00000080:1.0:1788796982.171133:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4a008d000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788796982.171142:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788796982.171150:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4a008d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788796982.171168:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796982.171173:0:20995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788796982.171177:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8fb3878acd28) has no exports 00010000:00010000:3.0:1788796982.558952:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796982.784052:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796982.784067:0:20995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788796982.784073:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb38805c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788796982.784078:0:20995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb38805c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788796982.784090:0:20995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788796982.784209:0:20995:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fb38805a000 00000020:01000000:1.0:1788796982.784229:0:20995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788796982.784233:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796982.784238:0:20995:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788796982.784242:0:20995:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8fb4bfa28000) has no exports 00000100:00100000:2.0:1788796982.784533:0:17220:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8fb3859d4600:17220] 0 exiting: rc = 1 00000100:00100000:2.0:1788796982.784640:0:17221:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8fb3859d5c00:17221] 1 exiting: rc = 0 00000100:00100000:3.0:1788796982.785053:0:18238:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8fb4856d1200:18238] 3 exiting: rc = 0 00000100:00100000:0.0:1788796982.785469:0:17222:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8fb3859d5600:17222] 2 exiting: rc = 0 00000100:00100000:1.0:1788796982.789875:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789888:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789895:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789901:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789908:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789913:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789919:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789924:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789930:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789937:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789946:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789954:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789959:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789964:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789970:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789975:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789981:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789987:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789992:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.789998:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790004:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790029:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790035:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790040:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790046:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790052:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790058:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790063:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790068:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790073:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790078:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790083:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790089:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790095:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790103:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790108:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790114:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790120:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790126:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790131:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790136:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790140:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790145:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790150:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790156:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790161:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790167:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790172:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790178:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790184:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790190:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790196:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790202:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790208:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790214:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790220:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790236:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790242:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790248:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790253:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790259:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790264:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790270:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.790276:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.812610:0:17223:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8fb3859d4a00:17223] 0 exiting: rc = 1 00000100:00100000:3.0:1788796982.817159:0:17224:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8fb3859d4200:17224] 1 exiting: rc = 0 00000100:00100000:1.0:1788796982.817305:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817318:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817325:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817333:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817338:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817344:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817350:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817355:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817360:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817366:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817373:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817379:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817385:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817390:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817396:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817401:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817407:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817412:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817417:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817423:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817429:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817434:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817441:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817448:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817454:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817459:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817465:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817492:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817497:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817503:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817509:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817515:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817520:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817526:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817532:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817538:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817545:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817550:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817556:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817562:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817567:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817572:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817577:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817582:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817587:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817592:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817598:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817603:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817609:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817614:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817620:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817625:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817630:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817636:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817642:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817648:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817653:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817660:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817666:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817672:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817677:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817731:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817744:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.817750:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.818453:0:17961:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8fb485583200:17961] 2 exiting: rc = 0 00000100:00100000:3.0:1788796982.818548:0:17225:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8fb4bd32d800:17225] 0 exiting: rc = 1 00000100:00100000:0.0:1788796982.818952:0:17226:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8fb4bd32c200:17226] 1 exiting: rc = 0 00000100:00100000:1.0:1788796982.820183:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820191:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820197:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820203:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820209:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820214:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820220:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820226:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820244:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820253:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820262:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820269:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820277:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820285:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820293:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820302:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820308:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820314:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820319:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820325:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820348:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820355:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820361:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820366:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820373:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820379:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820384:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820392:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820398:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820403:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820410:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820416:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820437:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820454:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820460:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820466:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820472:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820478:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820484:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820490:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820496:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820501:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820507:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820512:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820531:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820538:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820544:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820550:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820557:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820564:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820573:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820579:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820586:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820592:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820599:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820605:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820627:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820636:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820642:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820648:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820655:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820660:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820668:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.820674:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.850459:0:17228:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8fb48a3e5200:17228] 1 exiting: rc = 0 00000100:00100000:1.0:1788796982.850778:0:17227:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8fb3859d4e00:17227] 0 exiting: rc = 1 00000100:00100000:0.0:1788796982.853630:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853639:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853645:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853650:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853656:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853662:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853667:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853672:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853677:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.853703:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854032:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854038:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854061:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854066:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854071:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854075:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854080:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854086:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854093:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854099:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854104:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854110:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854115:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854121:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854126:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854131:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854136:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854142:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854152:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854157:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854163:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854168:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854174:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854180:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854186:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854190:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854196:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854201:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854206:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854212:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854217:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854222:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854228:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854234:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854240:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854246:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854252:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854265:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854271:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854276:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854282:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854287:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854292:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854371:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854377:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854381:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854386:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854391:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854396:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854400:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854405:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854410:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854415:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.854420:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796982.858443:0:17230:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8fb4bd1be400:17230] 1 exiting: rc = 0 00000100:00100000:0.0:1788796982.858582:0:17229:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8fb4bd1be200:17229] 0 exiting: rc = 1 00000100:00100000:2.0:1788796982.858661:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858669:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858674:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858705:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858922:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858927:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858933:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858938:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858943:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858947:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858952:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858957:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858962:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858967:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858973:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858978:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858983:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858988:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858994:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.858999:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859004:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859008:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859013:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859018:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859023:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859029:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859034:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859038:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859063:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859068:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859073:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859078:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859083:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859088:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859094:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859099:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859104:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859109:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859114:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859118:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859124:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859129:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859134:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859138:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859143:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859148:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859152:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859157:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859162:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859167:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859171:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859176:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859181:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859185:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859190:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859195:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859199:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859205:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859209:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859213:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859218:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859222:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859227:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.859238:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796982.862493:0:17232:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8fb4bd1bf400:17232] 1 exiting: rc = 0 00000100:00100000:1.0:1788796982.863630:0:17231:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8fb4bad14e00:17231] 0 exiting: rc = 1 00000100:00100000:2.0:1788796982.868212:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868223:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868229:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868235:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868240:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868247:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868252:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868257:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868262:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868267:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868272:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868277:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868282:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868287:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868304:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868311:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868316:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868322:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868327:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868332:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868337:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868342:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868347:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868352:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868357:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868361:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868366:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868372:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868376:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868381:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868386:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868390:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868395:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868401:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868425:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868430:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868436:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868442:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868446:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868452:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868457:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868461:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868466:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868471:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868477:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868482:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868487:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868492:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868497:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868502:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868507:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868512:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868518:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868523:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868529:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868535:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868540:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868546:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868551:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868557:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868563:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868568:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868573:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796982.868579:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.874670:0:17233:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8fb3859d6e00:17233] 0 exiting: rc = 1 00000100:00100000:3.0:1788796982.875046:0:17235:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8fb4bd527600:17235] 2 exiting: rc = 0 00000100:00100000:2.0:1788796982.875498:0:17234:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8fb4bd527c00:17234] 1 exiting: rc = 0 00000100:00100000:3.0:1788796982.875614:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875620:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875627:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875632:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875639:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875644:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875649:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875655:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875660:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875666:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.875672:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876040:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876067:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876074:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876079:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876085:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876091:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876106:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876111:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876117:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876123:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876130:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876136:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876141:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876149:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876154:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876159:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876164:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876171:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876176:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876181:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876187:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876192:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876198:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876204:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876209:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876229:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876235:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876241:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876246:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876252:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876258:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876263:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876268:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876274:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876279:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876284:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876290:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876404:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876413:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876418:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876423:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876442:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876450:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876456:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876461:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876467:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876472:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876478:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876483:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876489:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876495:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876501:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796982.876508:0:20995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788796982.885923:0:20995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796982.885937:0:20995:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788796982.885943:0:20995:0:(genops.c:885:class_export_put()) final put ffff8fb4846f4800/MDS_uuid 00000020:00000080:2.0:1788796982.885948:0:20995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4846f4800/MDS_uuid for MDS 00000020:01000000:2.0:1788796982.885968:0:20995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788796982.886123:0:20995:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788796983.572325:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796984.596561:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796984.596620:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796984.596627:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788796984.596629:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796984.596632:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788796984.596636:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb387634800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796984.596644:0:505:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 695 00000100:00080000:3.0:1788796984.596650:0:505:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788796984.596663:0:505:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fb387634800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788796984.596983:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a2300 x1875688984656768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796984.597037:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984656768:0@lo:38:kworker.0 00000400:00000100:0.0:1788796984.597096:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984656768 offset 0 length 520: 4 00000100:00080000:3.0:1788796984.597179:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796984.597183:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788796984.597185:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796984.597188:0:505:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 695 00000100:00080000:3.0:1788796984.597191:0:505:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788796984.597196:0:505:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fb3882fa000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788796984.597221:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a0700 x1875688984657024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796984.601333:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984656896:0@lo:400:kworker.0 00000400:00000100:1.0:1788796984.601401:0:3654:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984656896 offset 0 length 224: 4 00000100:00100000:0.0:1788796984.609058:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984657024:0@lo:38:kworker.0 00000400:00000100:0.0:1788796984.609118:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657024 offset 0 length 520: 4 00000100:00100000:3.0:1788796984.609411:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657152:0@lo:400:kworker.0 00000400:00000100:3.0:1788796984.609436:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657152 offset 0 length 224: 4 00010000:00010000:1.0:1788796985.628720:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796986.646238:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796986.646250:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788796986.646253:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796986.646256:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788796986.646327:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796986.646345:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788796986.646477:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984657280:0@lo:400:kworker.0 00000400:00000100:2.0:1788796986.646547:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657280 offset 0 length 224: 4 00000100:00100000:2.0:1788796986.646631:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796986.646638:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984657408:0@lo:400:kworker.0 00000400:00000100:2.0:1788796986.646668:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657408 offset 0 length 224: 4 00010000:00010000:3.0:1788796986.647061:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788796987.218764:0:21199:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788796987.232653:0:21199:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788796987.232910:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796987.232926:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796987.232934:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796987.232942:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796987.233069:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788796987.233075:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788796987.233100:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796987.233112:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a2300 x1875688984656768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796987.233133:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788796987.233139:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788796987.233146:0:21199:0:(import.c:65:import_set_state_nolock()) ffff8fb387634800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788796987.233151:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796987.233154:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a2300 x1875688984656768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796999 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796987.233162:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788796987.233165:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1788796987.233221:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984656768:0@lo:38:kworker.0 00000100:00080000:0.0:1788796987.234548:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788796987.234578:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a3800 x1875688984656896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797000 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796987.234654:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd4a80 x1875688984657280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797002 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796987.234672:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788796987.234677:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788796987.234713:0:21199:0:(import.c:65:import_set_state_nolock()) ffff8fb388282800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788796987.234779:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984657280:0@lo:400:kworker.0 00010000:00010000:1.0:1788796987.234861:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796987.234869:0:20997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796987.234878:0:20997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c33400 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796987.234883:0:20997:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796987.234894:0:20997:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796987.234901:0:20997:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796987.234907:0:20997:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788796987.234910:0:20997:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788796987.234912:0:20997:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788796987.234925:0:20997:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:1.0:1788796987.234929:0:20997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796987.234935:0:20997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33400/0x500835b7bd265b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265b73 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796987.234947:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796987.234948:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796987.234949:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796987.235055:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984656896:0@lo:400:kworker.0 00000100:00100000:2.0:1788796987.235081:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3653:1875688984657536:0@lo:39:umount.0 00000400:00000100:2.0:1788796987.235123:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657536 offset 0 length 224: 4 00010000:00010000:0.0:1788796987.667939:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788796988.194646:0:19542:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788796988.194656:0:19542:0:(genops.c:885:class_export_put()) final put ffff8fb4bad82000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788796988.194804:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bad82000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788796988.194855:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4bad86000 for lustre-OST0001 00000001:00100000:2.0:1788796988.197659:0:18724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788796988.197668:0:18724:0:(genops.c:885:class_export_put()) final put ffff8fb387632800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788796988.197803:0:21075:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387632800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788796988.207402:0:21075:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb387635000 for lustre-OST0000 00010000:00010000:1.0:1788796988.691843:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796989.651886:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796989.651898:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788796989.651901:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796989.651904:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788796989.652034:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796989.652055:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657664:0@lo:400:kworker.0 00000400:00000100:0.0:1788796989.652111:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657664 offset 0 length 224: 4 00010000:00010000:3.0:1788796989.716006:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796990.746007:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796991.316161:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796981/real 1788796981] req@ffff8fb4b9ecc380 x1875688984656512/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788796991 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796991.316198:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4b9ecc380 x1875688984656512/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788796991 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788796991.316219:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4846f1800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796991.316248:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788796991.316252:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3653:1875688984656512:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788796991.316750:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796991.316756:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788796991.316759:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb4846f1800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796991.316764:0:505:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 697 00000100:00080000:3.0:1788796991.316770:0:505:0:(import.c:630:import_select_connection()) MGC192.168.201.127@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788796991.316781:0:505:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import ffff8fb4846f1800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788796991.316817:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a3100 x1875688984657792/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796991.316844:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788796991.316848:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788796991.316942:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657920:0@lo:400:kworker.0 00000400:00000100:0.0:1788796991.316991:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984657920 offset 0 length 224: 4 00000100:00100000:2.0:1788796991.317144:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3653:1875688984657792:0@lo:250:kworker.0 00000400:00000100:2.0:1788796991.317170:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875688984657792 offset 0 length 520: 4 00010000:00010000:0.0:1788796991.765722:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796992.788616:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796993.813100:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796994.835837:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796995.860385:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788796996.372050:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788796996.372061:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788796996.372063:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788796996.372066:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788796996.372147:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984658048:0@lo:400:kworker.0 00000400:00000100:1.0:1788796996.372200:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984658048 offset 0 length 224: 4 00010000:00010000:1.0:1788796996.883970:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796997.468575:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796987/real 1788796987] req@ffff8fb4bacd5c00 x1875688984657536/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788796997 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796997.468632:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4bacd5c00 x1875688984657536/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788796997 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788796997.468663:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb388282800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788796997.468732:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3653:1875688984657536:0@lo:39:umount.0 00000100:00080000:2.0:1788796997.469725:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788796997.469760:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788796997.469768:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788796997.474516:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474549:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474557:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474564:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474618:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796997.474627:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474634:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474640:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474646:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796997.474670:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788796997.474675:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788796997.474751:0:21199:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788796997.474757:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788796997.474781:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796997.474789:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788796997.474794:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8fb4bab6cd28) has no exports 00000020:00080000:2.0:1788796997.474824:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8fb4bab6cd28) has no exports 00010000:00010000:1.0:1788796997.476846:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796997.476873:0:20997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.476890:0:20997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb480030400 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796997.476897:0:20997:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.476911:0:20997:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796997.476931:0:20997:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796997.476938:0:20997:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788796997.476965:0:20997:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788796997.476969:0:20997:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788796997.477002:0:20997:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:1.0:1788796997.477007:0:20997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477015:0:20997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb480030400/0x500835b7bd265b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265b49 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477040:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796997.477044:0:20997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477050:0:20997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7000 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788796997.477052:0:20997:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477060:0:20997:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796997.477065:0:20997:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796997.477084:0:20997:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788796997.477086:0:20997:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788796997.477089:0:20997:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788796997.477095:0:20997:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:1.0:1788796997.477098:0:20997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477105:0:20997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4c20e7000/0x500835b7bd265ea6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265ead expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796997.477121:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796997.477122:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796997.477124:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796997.477379:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788796997.487487:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb388990960 - data ffff8fb385d37a20/ffff8fb4856af400 00000020:01000000:2.0:1788796997.487777:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb4bd52f2a0 - data ffff8fb4aa9a66c0/ffff8fb48571c400 00100000:10000000:0.0:1788796997.501894:0:21199:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788796997.526905:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b57 00000020:00000080:1.0:1788796997.526917:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb387635800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788796997.526968:0:21199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb4bfa31800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788796997.526972:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb4bfa31800 2 00000020:01000004:1.0:1788796997.526975:0:21199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fb4bfa31800 from lustre-OST0000 00000020:00000080:1.0:1788796997.527001:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796997.527012:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788796997.527015:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb387632000/lustre-OST0000_UUID 00000020:00000080:1.0:1788796997.527018:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387632000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788796997.527025:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788796997.527073:0:21199:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788796997.527078:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788796997.527082:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796997.527097:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788796997.527104:0:21199:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8fb4bfad3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796997.527110:0:21199:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8fb4bab6b370) has exports, disconnecting them 00000020:00080000:1.0:1788796997.527114:0:21199:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8fb4bfad3000), last request at 1788796905 00000020:00000080:1.0:1788796997.527118:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b81 00000020:00080000:1.0:1788796997.527127:0:21199:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb4bfad3000): rc 0 00000020:00000080:1.0:1788796997.527132:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb4bfad3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788796997.530527:0:21075:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387635800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788796997.532504:0:21075:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfad3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788796997.541827:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788796997.541842:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788796997.541847:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788796997.541857:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796997.541943:0:21075:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb387634800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788796997.542163:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796997.542175:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788796997.542183:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb387636800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788796997.542188:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387636800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788796997.542200:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788796997.542304:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788796997.542309:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796997.542328:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788796997.542336:0:21199:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8fb388287800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788796997.542343:0:21199:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8fb4bafe3370) has exports, disconnecting them 00000020:00080000:2.0:1788796997.542348:0:21199:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8fb388287800), last request at 1788796905 00000020:00000080:2.0:1788796997.542353:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b96 00000020:00080000:2.0:1788796997.542370:0:21199:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb388287800): rc 0 00000020:00000080:2.0:1788796997.542375:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb388287800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788796997.542827:0:21075:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388287800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788796997.686220:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788796997.686234:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788796997.686240:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788796997.686251:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796997.686397:0:21075:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb388282800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788796997.687058:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796997.687072:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788796997.687080:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb388286000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788796997.687086:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb388286000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788796997.687100:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788796997.687197:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb4bfa31800 1 00000020:00000080:2.0:1788796997.687205:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265b34 00000020:00000080:2.0:1788796997.687214:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb4bfa36800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788796997.687232:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788796997.687236:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796997.687242:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788796997.687247:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8fb3878a99b8) has no exports 00000020:00000080:1.0:1788796997.687320:0:21075:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfa36800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788796997.767176:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796997.767199:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788796997.767207:0:21199:0:(genops.c:885:class_export_put()) final put ffff8fb4bfa33000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788796997.767214:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4bfa33000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788796997.767232:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788796997.767392:0:21199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fb4bfa36000 00000020:02000400:3.0:1788796997.767449:0:21199:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788796997.909114:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796998.935212:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796999.508441:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796984/real 1788796984] req@ffff8fb3881a0700 x1875688984657024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788796999 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796999.508478:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a0700 x1875688984657024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788796999 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788796999.508499:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796999.508526:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788796999.508530:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984657024:0@lo:38:kworker.0 00000100:00080000:0.0:1788796999.508638:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796999.508643:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788796999.508646:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796999.508648:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788796999.508652:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796999.508657:0:505:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 700 00000100:00080000:0.0:1788796999.508664:0:505:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788796999.508674:0:505:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fb3882fa000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788796999.508753:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd5c00 x1875688984658176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796999.508819:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796999.508834:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984658304:0@lo:400:kworker.0 00000400:00000100:0.0:1788796999.508884:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984658304 offset 0 length 224: 4 00000100:00100000:2.0:1788796999.509185:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984658176:0@lo:38:kworker.0 00000400:00000100:2.0:1788796999.509210:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984658176 offset 0 length 520: 4 00010000:00010000:1.0:1788796999.956010:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788797000.474542:0:3655:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796984/real 1788796984] req@ffff8fb3881a1500 x1875688984657152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797000 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797000.513914:0:3655:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8fb3881a1500 x1875688984657152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797000 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797000.513931:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8fb4b8d19800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788797000.513953:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788797000.541922:0:3655:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788797000.542572:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797000.542579:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797000.542582:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797000.542585:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788797000.542588:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788797000.542590:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788797000.542594:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb4b8d19800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797000.542605:0:21075:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1788797000.542626:0:21075:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8fb4b8d19800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788797000.542669:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd6300 x1875688984658432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797000.543044:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657152:0@lo:400:kworker.0 00000100:00100000:2.0:1788797000.543509:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3653:1875688984658432:0@lo:38:kworker.0 00000400:00000100:2.0:1788797000.543573:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688984658432 offset 0 length 520: 4 00010000:00010000:3.0:1788797000.980491:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797002.017579:0:20996:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788797002.579796:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796986/real 1788796986] req@ffff8fb4bacd6a00 x1875688984657408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797002.623133:0:3656:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8fb4bacd6a00 x1875688984657408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788797002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797002.623147:0:3656:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8fb4b8d19800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788797002.624168:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984657408:0@lo:400:kworker.0 00000020:01000004:0.0:1788797002.865092:0:21401:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788797002.882472:0:21401:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788797002.882577:0:21401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797002.882594:0:21401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797002.882602:0:21401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797002.882611:0:21401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797002.882636:0:21401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788797002.882641:0:21401:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788797002.882674:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797002.882711:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd5c00 x1875688984658176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797002.882728:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788797002.882735:0:21401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788797002.882742:0:21401:0:(import.c:65:import_set_state_nolock()) ffff8fb3882fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788797002.882747:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788797002.882751:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd5c00 x1875688984658176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797019 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797002.882759:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788797002.882763:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:3.0:1788797002.884629:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797002.884643:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.884654:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb483c33800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797002.884657:0:17209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.884670:0:17209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797002.884726:0:17209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797002.884749:0:17209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797002.884752:0:17209:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788797002.884755:0:17209:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788797002.884770:0:17209:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:3.0:1788797002.884775:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.884782:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33800/0x500835b7bd265cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265cd8 expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.885568:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797002.885573:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797002.885575:0:17209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797002.885616:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984658176:0@lo:38:kworker.0 00000100:00080000:0.0:1788797002.888172:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788797002.888189:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a2a00 x1875688984657664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797005 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888217:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a3b80 x1875688984657920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888226:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4b9ecf100 x1875688984658048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797002.888324:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657920:0@lo:400:kworker.0 00000100:00100000:0.0:1788797002.888345:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd7b80 x1875688984658304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797015 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888354:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd6300 x1875688984658432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797010 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888382:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788797002.888389:0:21401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788797002.888516:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984658048:0@lo:400:kworker.0 00000100:00100000:3.0:1788797002.888557:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984657664:0@lo:400:kworker.0 00000100:00080000:0.0:1788797002.888623:0:21401:0:(import.c:65:import_set_state_nolock()) ffff8fb4b8d19800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788797002.888631:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788797002.888635:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4b9ecf100 x1875688984658048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797012 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888644:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd7b80 x1875688984658304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797015 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888652:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb4bacd6300 x1875688984658432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788797010 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797002.888659:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788797002.888662:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788797002.888766:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3653:1875688984658432:0@lo:38:kworker.0 00000100:00100000:1.0:1788797002.889004:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3656:1875688984658304:0@lo:400:kworker.0 00010000:00010000:2.0:1788797002.895589:0:21401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.895617:0:21401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.895625:0:21401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.895632:0:21401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.896456:0:21401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797002.896470:0:21401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.896502:0:21401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.896509:0:21401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797002.896516:0:21401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.905753:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797002.905775:0:20997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906435:0:20997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797002.906444:0:20997:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906457:0:20997:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797002.906491:0:20997:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797002.906498:0:20997:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788797002.906500:0:20997:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788797002.906516:0:20997:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:3.0:1788797002.906520:0:20997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906527:0:20997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd265ca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265cae expref: -99 pid: 19541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906549:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797002.906554:0:20997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906559:0:20997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0200 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797002.906562:0:20997:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906569:0:20997:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797002.906576:0:20997:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797002.906581:0:20997:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788797002.906583:0:20997:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788797002.906586:0:20997:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:3.0:1788797002.906594:0:20997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797002.906601:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797002.906603:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797002.906605:0:20997:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797002.907092:0:21401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788797002.907101:0:21401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0200/0x500835b7bd265e98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265e9f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797002.907117:0:21401:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788797002.907124:0:21401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788797002.907126:0:21401:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788797002.907166:0:21401:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788797002.907171:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788797002.907178:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797002.907185:0:21401:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797002.907190:0:21401:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8fb3875b0000) has no exports 00000020:00080000:2.0:1788797002.907219:0:21401:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8fb3875b0000) has no exports 00010000:00010000:3.0:1788797002.907953:0:17210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788797002.916847:0:21401:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb3869e9420 - data ffff8fb4a0bc10d8/ffff8fb4856a7c00 00000020:01000000:0.0:1788797002.917062:0:21401:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fb38189dde0 - data ffff8fb385c0f870/ffff8fb387782c00 00100000:10000000:0.0:1788797002.926284:0:21401:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788797002.961181:0:21401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265cbc 00000020:00000080:0.0:1788797002.961192:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb387562000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788797002.961217:0:21401:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb387633800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788797002.961220:0:21401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb387633800 2 00000020:01000004:0.0:1788797002.961224:0:21401:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fb387633800 from lustre-OST0001 00000020:00000080:0.0:1788797002.961254:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797002.961265:0:21401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788797002.961268:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb387563800/lustre-OST0001_UUID 00000020:00000080:0.0:1788797002.961271:0:21401:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387563800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788797002.961278:0:21401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788797002.961397:0:21401:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2f06fb7a-06c9-40f6-936b-88b363d77b2c->MGS 00010000:00010000:0.0:1788797002.961419:0:21401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c32c00/0x500835b7bd265a00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd265a07 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797002.961430:0:21401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c32c00/0x500835b7bd265a00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd265a07 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797002.961437:0:21401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788797002.961440:0:21401:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788797002.961443:0:21401:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788797002.961457:0:21401:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00000020:00000080:2.0:1788797002.961460:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387562000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1788797002.961461:0:21401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c32c00/0x500835b7bd265a00 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd265a07 expref: -99 pid: 17952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797002.961475:0:21401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb483c33e00/0x500835b7bd2658ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x500835b7bd2658f6 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797002.961482:0:21401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb483c33e00/0x500835b7bd2658ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x500835b7bd2658f6 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797002.961507:0:21401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788797002.961510:0:21401:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788797002.961511:0:21401:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788797002.961523:0:21401:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fb4846f1800 00010000:00010000:0.0:1788797002.961526:0:21401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb483c33e00/0x500835b7bd2658ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x500835b7bd2658f6 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788797002.961543:0:21401:0:(import.c:65:import_set_state_nolock()) ffff8fb4846f1800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788797002.961547:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788797002.961549:0:21401:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788797002.961550:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788797002.961554:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788797002.961565:0:21401:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fb3881a3100 x1875688984657792/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788797006 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788797002.963610:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788797002.963618:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1788797002.963967:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2f06fb7a-06c9-40f6-936b-88b363d77b2c:3653:1875688984657792:0@lo:250:kworker.0 10000000:01000000:0.0:1788797002.964167:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788797002.964179:0:21401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd2658da 00000020:00000080:0.0:1788797002.964187:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb4846f4000/2f06fb7a-06c9-40f6-936b-88b363d77b2c 00000020:01000000:0.0:1788797002.964207:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.127@tcp (flags='') 00000020:00000080:0.0:1788797002.964216:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797002.964223:0:21401:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788797002.964227:0:21401:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8fb4bfa299b8) has no exports 10000000:01000000:3.0:1788797002.964290:0:17218:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1788797002.964418:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4846f4000/2f06fb7a-06c9-40f6-936b-88b363d77b2c for MGC192.168.201.127@tcp 10000000:01000000:0.0:1788797002.964456:0:21401:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.127@tcp: client import never connected 00000100:00080000:0.0:1788797002.964460:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788797002.964462:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788797002.964465:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788797002.964467:0:21401:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788797002.964512:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788797002.964518:0:21401:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.127@tcp (uuid 2f06fb7a-06c9-40f6-936b-88b363d77b2c) 00000020:01000000:0.0:1788797002.964524:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788797002.964541:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788797002.964545:0:21401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788797002.964550:0:21401:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8fb3882fc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788797002.964555:0:21401:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8fb4bafe0000) has exports, disconnecting them 00000020:00080000:0.0:1788797002.964559:0:21401:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8fb3882fc800), last request at 1788796923 00000020:00000080:0.0:1788797002.964563:0:21401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265ce6 00000020:00080000:0.0:1788797002.964573:0:21401:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb3882fc800): rc 0 00000020:00000080:0.0:1788797002.964577:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb3882fc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788797002.965578:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4846f1800 for MGC192.168.201.127@tcp 00000020:00000080:2.0:1788797002.965588:0:505:0:(genops.c:885:class_export_put()) final put ffff8fb4846f1000/2f06fb7a-06c9-40f6-936b-88b363d77b2c 00000020:00000080:2.0:1788797002.965590:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4846f1000/2f06fb7a-06c9-40f6-936b-88b363d77b2c for MGC192.168.201.127@tcp 00000020:01000000:2.0:1788797002.965603:0:505:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.127@tcp (2f06fb7a-06c9-40f6-936b-88b363d77b2c) 00000020:00000080:2.0:1788797002.965876:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882fc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788797002.971049:0:21401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788797002.971059:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788797002.971064:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788797002.971071:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788797002.971274:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797002.971284:0:21401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788797002.971301:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788797002.971308:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797002.971313:0:21401:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788797002.971320:0:21401:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8fb3882fb800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788797002.971327:0:21401:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8fb4bafe19b8) has exports, disconnecting them 00000020:00080000:2.0:1788797002.971331:0:21401:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8fb3882fb800), last request at 1788796923 00000020:00000080:2.0:1788797002.971335:0:21401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265cfb 00000020:00080000:2.0:1788797002.971352:0:21401:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fb3882fb800): rc 0 00000020:00000080:2.0:1788797002.971356:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb3882fb800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788797002.972458:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb3882fa000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788797002.972475:0:505:0:(genops.c:885:class_export_put()) final put ffff8fb3882fa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788797002.972479:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882fa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788797002.972494:0:505:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788797002.972561:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882fb800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788797002.973774:0:21401:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788797002.973783:0:21401:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788797002.973787:0:21401:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788797002.973801:0:21401:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788797002.973831:0:505:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8fb4b8d19800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788797002.975767:0:20996:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788797002.976114:0:17209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788797002.976184:0:20997:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788797002.976252:0:17210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788797002.976393:0:17205:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8fb4b8d14800:17205] 1 exiting: rc = 0 00000100:00100000:0.0:1788797002.977231:0:17204:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8fb488aeec00:17204] 0 exiting: rc = 1 00000100:00100000:3.0:1788797002.977495:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.977805:0:17207:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8fb4b8d15e00:17207] 1 exiting: rc = 0 00000100:00100000:3.0:1788797002.977867:0:17206:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8fb38184ce00:17206] 0 exiting: rc = 1 00000100:00100000:3.0:1788797002.977945:0:17208:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8fb4995dac00:17208] 2 exiting: rc = 0 00000100:00100000:3.0:1788797002.978800:0:20248:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8fb3889fb800:20248] 3 exiting: rc = 0 00000100:00100000:3.0:1788797002.978869:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.978889:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979066:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979075:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979081:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979088:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979093:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979098:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979104:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979109:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979113:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979118:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979123:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979128:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979133:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979138:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979144:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979149:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979155:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979160:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979164:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979169:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979173:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979178:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979183:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979188:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979192:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979197:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979202:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979207:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979212:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979217:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979222:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979227:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979231:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979236:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979247:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979252:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979256:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979261:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979265:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979271:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979276:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979281:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979286:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979290:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979373:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979378:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979383:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979387:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979392:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979396:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979401:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979405:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979410:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979414:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979419:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979423:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979428:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979432:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979437:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979441:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979446:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788797002.979451:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788797003.012271:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788797003.012285:0:21401:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788797003.012301:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb3882ff800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788797003.012306:0:21401:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb3882ff800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788797003.012318:0:21401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788797003.012400:0:21401:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb387633800 1 00000020:00000080:3.0:1788797003.012417:0:21401:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x500835b7bd265ca0 00000020:00000080:3.0:1788797003.012424:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb387921800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788797003.012438:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788797003.012450:0:505:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387921800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788797003.012463:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788797003.012468:0:21401:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788797003.012471:0:21401:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8fb4bab68000) has no exports 00000020:00000080:2.0:1788797003.151440:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797003.151454:0:21401:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788797003.151460:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb387630800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788797003.151464:0:21401:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb387630800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788797003.151477:0:21401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788797003.151795:0:21401:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fb387637000 00000020:01000000:2.0:1788797003.151826:0:21401:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788797003.151830:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788797003.151834:0:21401:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788797003.151838:0:21401:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8fb3878a8000) has no exports 00000020:00000080:2.0:1788797003.151859:0:21401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788797003.151863:0:21401:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788797003.151875:0:21401:0:(genops.c:885:class_export_put()) final put ffff8fb4aa0d7000/OSS_uuid 00000020:00000080:2.0:1788797003.151877:0:21401:0:(genops.c:844:class_export_destroy()) destroying export ffff8fb4aa0d7000/OSS_uuid for OSS 00000020:01000000:2.0:1788797003.151881:0:21401:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788797003.151973:0:18729:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8fb4bda02e00:18729] 1 exiting: rc = 0 00000100:00100000:2.0:1788797003.152072:0:19034:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8fb3818be200:19034] 3 exiting: rc = 0 00000100:00100000:2.0:1788797003.152130:0:18728:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8fb4980a4400:18728] 0 exiting: rc = 1 00000100:00100000:1.0:1788797003.152717:0:18730:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8fb4980a5400:18730] 2 exiting: rc = 0 00000100:00080000:0.0:1788797003.153020:0:17217:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788797003.154613:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154624:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154631:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154639:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154644:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154649:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154656:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154662:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154668:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.154674:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156809:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156826:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156831:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156837:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156842:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156847:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156852:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156856:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156861:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156866:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156871:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156877:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156881:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156887:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156892:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156901:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156906:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156911:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156943:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156949:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156954:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156959:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156964:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156970:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156975:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156980:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156985:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156990:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.156995:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157000:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157004:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157009:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157014:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157019:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157024:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157028:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157032:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157037:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157041:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157045:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157050:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157054:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157059:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157063:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157075:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157081:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157085:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157090:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157095:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157099:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157104:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157109:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157113:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.157122:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797003.163697:0:18731:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8fb38184d800:18731] 0 exiting: rc = 1 00000100:00100000:1.0:1788797003.164164:0:18732:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8fb48566e000:18732] 1 exiting: rc = 0 00000100:00100000:2.0:1788797003.164355:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164370:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164376:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164383:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164388:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164393:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164399:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164405:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164410:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164415:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164420:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164426:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164432:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164439:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164445:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164449:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164454:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164459:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164465:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164470:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164475:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164480:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164485:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164490:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164496:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164502:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164507:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164513:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164518:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164523:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164528:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164533:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164537:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164542:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164561:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164568:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164572:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164577:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164581:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164586:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164591:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164596:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164600:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164605:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164610:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164615:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164619:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164624:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164629:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164633:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164638:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164644:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164649:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164653:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164658:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164663:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164668:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164672:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164677:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164707:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164712:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164717:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164766:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.164778:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788797003.166268:0:18734:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8fb3879dde00:18734] 1 exiting: rc = 0 00000100:00100000:0.0:1788797003.166583:0:18733:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8fb388138400:18733] 0 exiting: rc = 1 00000100:00100000:0.0:1788797003.167447:0:18735:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8fb4876faa00:18735] 2 exiting: rc = 0 00000100:00100000:2.0:1788797003.167777:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167796:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167804:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167810:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167815:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167841:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167857:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167864:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167869:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167875:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167881:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167887:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167892:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167899:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167905:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167910:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167916:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167921:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.167927:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168170:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168180:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168186:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168192:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168198:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168204:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168209:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168215:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168221:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168227:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168233:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168257:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168264:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168269:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168275:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168280:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168287:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168293:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168299:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168305:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168317:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168340:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168346:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168351:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168364:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168370:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168376:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168382:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168389:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168395:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168400:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168406:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168412:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168418:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168424:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168431:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168445:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168460:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168467:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168472:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168650:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168670:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168677:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168748:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.168762:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.181192:0:18736:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8fb4856e6400:18736] 0 exiting: rc = 1 00000100:00100000:1.0:1788797003.182662:0:18737:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8fb4856e7000:18737] 1 exiting: rc = 0 00000100:00100000:2.0:1788797003.183629:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183639:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183645:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183651:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183657:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183663:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183669:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183674:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183831:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183839:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183865:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183871:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183876:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183882:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183888:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183893:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183898:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183904:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183909:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183915:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183921:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183926:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.183932:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184058:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184063:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184069:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184075:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184080:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184085:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184090:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184096:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184101:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184107:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184113:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184118:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184124:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184129:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184134:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184141:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184146:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184152:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184157:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184163:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184169:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184174:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184187:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184193:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184198:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184204:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184210:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184215:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184221:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184227:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184233:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184239:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184244:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184250:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184256:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184262:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184268:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184273:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184278:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184285:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.184300:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788797003.191982:0:18739:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8fb4a23a7800:18739] 1 exiting: rc = 0 00000100:00100000:1.0:1788797003.192387:0:18738:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8fb484c5dc00:18738] 0 exiting: rc = 1 00000100:00100000:2.0:1788797003.192493:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192510:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192518:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192525:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192531:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192537:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192543:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192549:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192557:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192563:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192589:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192596:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192603:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192610:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192618:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192626:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192643:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192650:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192656:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192662:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192671:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192677:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192729:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192737:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192743:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192749:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192755:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192760:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192766:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192772:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192778:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192794:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192802:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192808:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192829:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192836:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192843:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192849:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192856:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192862:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192868:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192874:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192880:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192887:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192893:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192900:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192921:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192929:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192945:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192952:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192959:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192972:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192978:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192984:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192990:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.192996:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193002:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193008:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193185:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193195:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193202:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193209:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193224:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788797003.193238:0:21401:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788797003.214638:0:21401:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788797026.400281:0:22166:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788797038.539103:0:22766:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788797038.539109:0:22766:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788797038.539110:0:22766:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788797038.539211:0:22766:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fb4b9fd8800 00000020:01000004:0.0:1788797038.539226:0:22766:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788797038.539232:0:22766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788797038.539245:0:22766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8fb4bafe4d28) 00000020:00000080:0.0:1788797038.539258:0:22766:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788797038.631286:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.639592:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788797038.642525:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.644037:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.644265:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.644453:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.645100:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.645435:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.646003:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.647086:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.647429:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.648268:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.649187:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788797038.650186:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788797038.652991:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.654200:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.654848:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.655182:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.655404:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.656141:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.656423:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.656715:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.657122:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.657356:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.657602:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.658109:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.658322:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.658574:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.659078:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788797038.659426:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788797038.660613:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.667189:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.667614:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.668045:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.668404:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788797038.668666:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.669117:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.669451:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.669704:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788797038.670529:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788797038.671136:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788797038.672243:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788797038.672597:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788797038.678701:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788797038.679473:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788797038.682527:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788797038.688408:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.691099:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.691662:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.692190:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.693130:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.693419:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788797038.693588:0:22766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1788797038.697034:0:22766:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788797038.697290:0:22766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788797038.697301:0:22766:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788797038.697317:0:22766:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd2661e0 00000020:01000004:0.0:1788797038.697326:0:22766:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788797038.697332:0:22766:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788797038.697337:0:22766:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fb4b9fd8800 from MGS 00000020:01000004:0.0:1788797038.697341:0:22766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788797038.697351:0:22766:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8fb4bafe19b8) 00000020:00000080:0.0:1788797038.697361:0:22766:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788797038.697429:0:22766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4b9fd8800 from MGS, refs=2 00080000:01000000:0.0:1788797038.697434:0:22766:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788797038.697439:0:22766:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd2661ee 00000100:00100000:0.0:1788797038.697535:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788797038.697772:0:22766:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788797038.697779:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788797038.702262:0:22766:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788797038.702274:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788797038.703566:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797038.704112:0:22766:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788797038.704118:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788797038.707039:0:22766:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788797038.707055:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788797038.717581:0:22766:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788797038.717618:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788797038.719448:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797038.719452:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797038.719454:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797038.719984:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797038.719987:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797038.719989:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797038.720525:0:22766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:2.0:1788797038.725864:0:22766:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788797038.726562:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788797038.726606:0:22766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788797038.726645:0:22766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:1.0:1788797038.727010:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788797038.727316:0:22766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788797038.727707:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.727873:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788797038.727880:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788797038.736468:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788797038.736487:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788797038.736912:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788797038.736919:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788797038.738145:0:22766:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788797038.738167:0:22766:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.127@tcp' 00000020:01000004:3.0:1788797038.738168:0:22766:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788797038.738197:0:22766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.127@tcp (typ=mgc) 00000020:00000080:3.0:1788797038.738210:0:22766:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.127@tcp (ffff8fb3875b3370) 00000020:00000080:3.0:1788797038.738225:0:22766:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788797038.738307:0:22766:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb4b9fdd000@MGC192.168.201.127@tcp: add connection 192.168.201.127@tcp at head 00000100:00080000:2.0:1788797038.738473:0:22783:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788797038.738599:0:22766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.127@tcp-0 is initialized 00000040:01000000:3.0:1788797038.738606:0:22766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788797038.739153:0:22784:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788797038.739221:0:22766:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.127@tcp (uuid 943c4c9d-8ce2-4132-a4c5-0a007618de16) 00000020:00000080:3.0:1788797038.739238:0:22766:0:(genops.c:1384:class_connect()) connect: client 943c4c9d-8ce2-4132-a4c5-0a007618de16, cookie 0x500835b7bd2661fc 00000100:00080000:3.0:1788797038.739247:0:22766:0:(import.c:545:import_select_connection()) MGC192.168.201.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797038.739256:0:22766:0:(import.c:666:import_select_connection()) MGC192.168.201.127@tcp: import ffff8fb4b9fdd000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797038.739287:0:22766:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a2a00 x1875688984658560/t0(0) o250->MGC192.168.201.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797038.739313:0:22766:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 943c4c9d-8ce2-4132-a4c5-0a007618de16->MGS 00000020:01000004:3.0:1788797038.739333:0:22766:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788797038.739337:0:22766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788797038.739349:0:22766:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8fb3875b4d28) 00000020:00000080:3.0:1788797038.739358:0:22766:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788797038.739546:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943c4c9d-8ce2-4132-a4c5-0a007618de16:3653:1875688984658560:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788797038.739612:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797038.743762:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984658560 00000100:00100000:2.0:1788797038.743779:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984658560 00000100:00100000:2.0:1788797038.743823:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797038.743832:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3653:x1875688984658560:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788797038.743872:0:22781:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 943c4c9d-8ce2-4132-a4c5-0a007618de16@0@lo t0 exp 0000000000000000 cur 754 last 0 00000020:00000080:2.0:1788797038.743902:0:22781:0:(genops.c:1384:class_connect()) connect: client 943c4c9d-8ce2-4132-a4c5-0a007618de16, cookie 0x500835b7bd26620a 00000100:00080000:2.0:1788797038.744036:0:22781:0:(import.c:65:import_set_state_nolock()) ffff8fb4b9f48800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797038.744123:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+5:3653:x1875688984658560:12345-0@lo:250:mount.lustre.0 Request processed in 291us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.744131:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797038.744190:0:3653:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788797038.744201:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1788797038.744210:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788797038.744214:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788797038.744217:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4b9fdd000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788797038.744220:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788797038.744229:0:3653:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788797038.744234:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943c4c9d-8ce2-4132-a4c5-0a007618de16:3653:1875688984658560:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788797038.760010:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.760212:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797038.760219:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788797038.765224:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788797038.765241:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788797038.765647:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788797038.765670:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788797038.766628:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.767010:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788797038.767016:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788797038.770284:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788797038.770296:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788797038.820350:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797038.820597:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788797038.820604:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788797038.823064:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788797038.823076:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788797038.823854:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797038.824061:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788797038.824067:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788797038.825133:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788797038.825142:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788797038.826183:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.826357:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788797038.826372:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788797038.827536:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788797038.827546:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788797038.833728:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.834087:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788797038.834093:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788797038.844116:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788797038.844135:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788797038.866806:0:22766:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788797038.867026:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788797038.867034:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788797038.873119:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788797038.873133:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788797038.874076:0:22766:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788797038.874086:0:22766:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788797038.876039:0:22766:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788797038.876076:0:22766:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788797038.876083:0:22766:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788797038.876187:0:22766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788797038.876221:0:22766:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788797038.876225:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788797038.876227:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797038.876228:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797038.876229:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797038.876230:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797038.876231:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797038.876233:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797038.876234:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797038.876236:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797038.876237:0:22766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788797038.876240:0:22766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788797038.876242:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788797038.876243:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797038.876244:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797038.876245:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797038.876247:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797038.876248:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797038.876248:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797038.876254:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797038.876255:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797038.876256:0:22766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788797038.876295:0:22766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788797038.876315:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788797038.876386:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797038.876430:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4867ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788797038.876750:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984658688 00000100:00100000:2.0:1788797038.876760:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984658688 00000100:00100000:3.0:1788797038.876907:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797038.876921:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+5:22766:x1875688984658688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788797038.876976:0:22782:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788797038.876979:0:22782:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788797038.876982:0:22782:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788797038.877341:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788797038.878571:0:22782:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788797038.881553:0:22805:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788797038.881562:0:22805:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788797038.881565:0:22805:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788797038.881568:0:22805:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788797038.881807:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788797038.882060:0:22782:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788797038.882071:0:22782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788797038.885823:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+5:22766:x1875688984658688:12345-0@lo:253:mount.lustre.0 Request processed in 8895us (9427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797038.885843:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797038.886318:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788797038.886335:0:22766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788797038.886338:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788797038.886340:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788797038.886341:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797038.886343:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797038.886344:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797038.886345:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797038.886346:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788797038.886348:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788797038.886350:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797038.886351:0:22766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788797038.886374:0:22766:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fb4b9fd8800 from lustre-MDT0000 10000000:01000000:0.0:1788797038.886410:0:22766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788797038.886414:0:22766:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788797038.886418:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fb3875b3370 10000000:01000000:0.0:1788797038.886422:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788797038.886431:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fb3875b3370 from 1 10000000:01000000:0.0:1788797038.886434:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788797038.886545:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.886557:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.886581:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797038.886601:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797038.887920:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797038.887973:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797038.888177:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984658816 00000100:00100000:2.0:1788797038.888187:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984658816 00000100:00100000:2.0:1788797038.888243:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797038.888252:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+5:22766:x1875688984658816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797038.888267:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797038.888286:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29c200/0x500835b7bd266218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266211 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797038.888313:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29c200/0x500835b7bd266218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266211 expref: 6 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797038.888340:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29c200/0x500835b7bd266218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266211 expref: 6 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797038.888349:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29c200, rc 0) 00000100:00100000:2.0:1788797038.888391:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+6:22766:x1875688984658816:12345-0@lo:101:mount.lustre.0 Request processed in 140us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.888397:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788797038.888964:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797038.888982:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.888992:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797038.889080:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797038.889115:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797038.889146:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797038.889206:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984658944 00000100:00100000:1.0:1788797038.889212:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984658944 00000100:00100000:1.0:1788797038.889245:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788797038.889252:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+6:22766:x1875688984658944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797038.889328:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+6:22766:x1875688984658944:12345-0@lo:501:mount.lustre.0 Request processed in 76us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788797038.889335:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797038.889406:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984658944:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788797038.889437:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788797038.889456:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.889473:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797038.889483:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fb4b9fd8800 10000000:01000000:0.0:1788797038.889487:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788797038.889498:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fb4b9fd8800 10000000:01000000:0.0:1788797038.889500:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788797038.889503:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fb4b9fd8800 from 1 10000000:01000000:0.0:1788797038.889506:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788797038.889525:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.889532:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.889540:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797038.889564:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797038.889589:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797038.889612:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40780 going to sleep for 11 seconds 00000100:00100000:3.0:1788797038.889666:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659072 00000100:00100000:3.0:1788797038.889672:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659072 00000100:00100000:3.0:1788797038.889925:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797038.889934:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+6:22766:x1875688984659072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797038.889943:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797038.889958:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4813d1e00/0x500835b7bd266226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26621f expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797038.889998:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4813d1e00/0x500835b7bd266226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26621f expref: 7 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797038.890007:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4813d1e00/0x500835b7bd266226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26621f expref: 7 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797038.890015:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4813d1e00, rc 0) 00000100:00100000:3.0:1788797038.890059:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+7:22766:x1875688984659072:12345-0@lo:101:mount.lustre.0 Request processed in 128us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797038.890065:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797038.890131:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797038.890144:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266226 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.890153:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266226 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797038.890165:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788797038.890178:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266226 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.890186:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1c00/0x500835b7bd26621f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266226 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797038.890202:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788797038.890206:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788797038.890210:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fb4b9fd8800 10000000:01000000:0.0:1788797038.890212:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788797038.890215:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788797038.890217:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788797038.890232:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.890240:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797038.890247:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797038.890259:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797038.890281:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797038.898541:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659200 00000100:00100000:1.0:1788797038.898557:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659200 00000100:00100000:1.0:1788797038.898620:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797038.898629:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+7:22766:x1875688984659200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797038.898649:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797038.898673:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb3881c5200/0x500835b7bd266234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26622d expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797038.898718:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c5200/0x500835b7bd266234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26622d expref: 8 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797038.898759:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb3881c5200/0x500835b7bd266234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26622d expref: 8 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797038.898769:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb3881c5200, rc 0) 00000100:00100000:1.0:1788797038.900030:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+8:22766:x1875688984659200:12345-0@lo:101:mount.lustre.0 Request processed in 1396us (9741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797038.900041:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788797038.900773:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797038.901147:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797038.901171:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266234 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797038.901183:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266234 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797038.901951:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797038.902013:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797038.902048:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4867add80 going to sleep for 11 seconds 00000100:00100000:3.0:1788797038.902251:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659328 00000100:00100000:3.0:1788797038.902259:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659328 00000100:00100000:3.0:1788797038.903465:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797038.903482:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+8:22766:x1875688984659328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797038.903668:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22766:x1875688984659328:12345-0@lo:501:mount.lustre.0 Request processed in 194us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797038.903677:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797038.905204:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797038.905290:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797038.905375:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797038.905407:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797038.905792:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659456 00000100:00100000:2.0:1788797038.905801:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659456 00000100:00100000:2.0:1788797038.905850:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797038.905860:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22766:x1875688984659456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797038.906504:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22766:x1875688984659456:12345-0@lo:503:mount.lustre.0 Request processed in 644us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.906514:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797038.906828:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984659456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797038.907467:0:22806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22806:1875688984659584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797038.908494:0:22806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797038.908801:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659584 00000100:00100000:1.0:1788797038.908812:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659584 00000100:00100000:1.0:1788797038.909051:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797038.909062:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22806:x1875688984659584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797038.909816:0:22806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4861829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797038.911062:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22806:x1875688984659584:12345-0@lo:502:llog_process_th.0 Request processed in 1996us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797038.911075:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797038.911188:0:22806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22806:1875688984659584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788797038.911226:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797038.911237:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797038.911246:0:22806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788797038.911252:0:22806:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788797038.911255:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797038.911270:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8fb4980e3370) 00000020:00000080:1.0:1788797038.911287:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788797038.911294:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788797038.911375:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788797038.911382:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd266242 00000020:00000080:1.0:1788797038.912953:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788797038.912964:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797038.912971:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797038.912972:0:22806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788797038.912975:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797038.912982:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797038.912983:0:22806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788797038.912987:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797038.913000:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8fb4980e0000) 00000020:00000080:1.0:1788797038.913017:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788797038.913022:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788797038.913024:0:22806:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788797038.913027:0:22806:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788797038.913033:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788797038.913088:0:22806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4b9fd8800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788797038.913099:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8fb4980e19b8) 00000020:00000080:1.0:1788797038.913107:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788797038.913177:0:22806:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788797038.913183:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd266257 00000020:00000080:1.0:1788797038.913292:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788797038.913299:0:22806:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788797038.913302:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x500835b7bd26625e 00080000:01000000:1.0:1788797038.913307:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788797038.913311:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd266265 00010000:00010000:1.0:1788797039.027452:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788797039.028863:0:22806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:1.0:1788797039.029347:0:22806:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788797039.029919:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8fb4980e4d28) 00000020:00000080:1.0:1788797039.029937:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788797039.030008:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788797039.030015:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd266273 00000020:00000080:3.0:1788797039.030852:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788797039.034841:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x500835b7bd26627a 00000020:00000080:1.0:1788797039.036506:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788797039.036520:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797039.036527:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.036529:0:22806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788797039.036533:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788797039.036536:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788797039.036537:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797039.036539:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797039.036540:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788797039.036543:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.036544:0:22806:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788797039.036546:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797039.036551:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.036552:0:22806:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788797039.036556:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788797039.036602:0:22806:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788797039.036618:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797039.036621:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.036623:0:22806:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788797039.036625:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797039.036628:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.036629:0:22806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788797039.036632:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788797039.036638:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:00000080:1.0:1788797039.036663:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797039.036700:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8fb4bfa299b8) 00000020:00000080:1.0:1788797039.036719:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788797039.036725:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788797039.036800:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788797039.036806:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788797039.036813:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd266288 00010000:00080000:1.0:1788797039.036844:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb38769f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1788797039.039266:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788797039.043073:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788797039.043099:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788797039.043134:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788797039.043154:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd26628f 00000100:00080000:2.0:1788797039.043164:0:22806:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797039.043175:0:22806:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1788797039.043217:0:22806:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb387b92300 x1875688984659712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797039.043247:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788797039.043323:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797039.043328:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797039.043330:0:22806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788797039.043334:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797039.043337:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788797039.043338:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797039.043340:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797039.043341:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797039.043344:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797039.043345:0:22806:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797039.043347:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788797039.043351:0:22806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788797039.043354:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797039.043474:0:22806:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788797039.043481:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788797039.043485:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:2.0:1788797039.043509:0:22806:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788797039.043512:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788797039.043527:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fb4bbe58000) 00000020:00000080:2.0:1788797039.043539:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788797039.043554:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788797039.043614:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788797039.043619:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788797039.043629:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd26629d 00010000:00080000:2.0:1788797039.043655:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb49000d800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1788797039.043886:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788797039.044914:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788797039.044989:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.045465:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984659712 00000100:00100000:0.0:1788797039.045475:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984659712 00000100:00100000:0.0:1788797039.045507:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797039.045516:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1875688984659712:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788797039.045558:0:22792:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788797039.046747:0:22806:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788797039.047270:0:22806:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788797039.063637:0:22806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797039.063935:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1788797039.068107:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1875688984659712:12345-0@lo:38:llog_process_th.0 Request processed in 22581us (23107us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797039.068123:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788797039.068187:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797039.068192:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797039.068197:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659712:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788797039.069758:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788797039.070137:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788797039.070142:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788797039.070656:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788797039.070668:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788797039.070743:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788797039.070765:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd2662a4 00000100:00080000:3.0:1788797039.070775:0:22806:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797039.070787:0:22806:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fb49000d800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797039.070822:0:22806:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a3b80 x1875688984659840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797039.070888:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788797039.070949:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984659840 offset 0 length 520: 4 00000100:00080000:3.0:1788797039.071000:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788797039.071064:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797039.071068:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797039.071070:0:22806:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788797039.071073:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788797039.071075:0:22806:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788797039.071077:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797039.071078:0:22806:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788797039.071080:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788797039.071082:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797039.071083:0:22806:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788797039.071085:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788797039.071089:0:22806:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788797039.071092:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797039.071093:0:22806:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788797039.071096:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788797039.071099:0:22806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:3.0:1788797039.071118:0:22806:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788797039.071120:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797039.071131:0:22806:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fb3875b19b8) 00000020:00000080:3.0:1788797039.071141:0:22806:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788797039.071145:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788797039.071197:0:22806:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788797039.071203:0:22806:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788797039.071207:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x500835b7bd2662b2 00010000:00080000:3.0:1788797039.071232:0:22806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb385a68800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1788797039.071439:0:22806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788797039.071499:0:22806:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788797039.071513:0:22806:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788797039.073205:0:22806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797039.073435:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788797039.073580:0:22806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788797039.074036:0:22814:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788797039.074042:0:22814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788797039.075075:0:22806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788797039.075089:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797039.075131:0:22806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788797039.075153:0:22806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd2662b9 00000100:00080000:1.0:1788797039.075164:0:22806:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797039.075178:0:22806:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797039.075213:0:22806:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9eced80 x1875688984659968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797039.075281:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788797039.075337:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984659968 offset 0 length 520: 4 00000100:00080000:1.0:1788797039.075453:0:22806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788797039.075553:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797039.075558:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.075559:0:22806:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788797039.075562:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797039.075567:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.075569:0:22806:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788797039.075571:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788797039.075573:0:22806:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788797039.075575:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797039.075577:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.075587:0:22806:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788797039.075591:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797039.075593:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797039.075595:0:22806:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788797039.075598:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788797039.075626:0:22806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22806:1875688984660096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797039.075673:0:22806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797039.075714:0:22806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb48a4acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.075797:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660096 00000100:00100000:3.0:1788797039.075805:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660096 00000100:00100000:3.0:1788797039.075855:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797039.075864:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22806:x1875688984660096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797039.075987:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22806:x1875688984660096:12345-0@lo:502:llog_process_th.0 Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.075994:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797039.076051:0:22806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22806:1875688984660096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788797039.076073:0:22806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797039.076077:0:22806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797039.076078:0:22806:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788797039.076081:0:22806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788797039.076286:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788797039.076311:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788797039.076332:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266234 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.076344:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0400/0x500835b7bd26622d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266234 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797039.076352:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb4b9fd8800 from 1 10000000:01000000:0.0:1788797039.076355:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797039.076456:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.076464:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.076485:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797039.076499:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797039.076529:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.076554:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.076677:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660224 00000100:00100000:2.0:1788797039.076791:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660224 00000100:00100000:2.0:1788797039.076852:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797039.076862:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+9:22766:x1875688984660224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797039.076873:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797039.076888:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2662c0 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.076910:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 10 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.076920:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 10 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.076928:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29ce00, rc 0) 00000100:00100000:2.0:1788797039.076968:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+10:22766:x1875688984660224:12345-0@lo:101:mount.lustre.0 Request processed in 108us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.076974:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797039.077039:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797039.077050:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.077059:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797039.077612:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660352:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788797039.077652:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.077971:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.078042:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660352 00000100:00100000:3.0:1788797039.078049:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660352 00000100:00100000:3.0:1788797039.078078:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797039.078086:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+10:22766:x1875688984660352:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788797039.078104:0:22779:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788797039.078111:0:22779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788797039.078195:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+10:22766:x1875688984660352:12345-0@lo:256:mount.lustre.0 Request processed in 109us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.078202:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797039.078278:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660352:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788797039.078915:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788797039.078935:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.078945:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797039.078953:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb4b9fd8800 from 1 10000000:01000000:0.0:1788797039.078955:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797039.078990:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.078998:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.079007:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797039.079023:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797039.079057:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.079076:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.079231:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660480 00000100:00100000:3.0:1788797039.079236:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660480 00000100:00100000:3.0:1788797039.079264:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797039.079272:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+10:22766:x1875688984660480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797039.079282:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797039.079299:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2662ce expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.079320:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2662ce expref: 11 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.079330:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662ce expref: 11 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.079338:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4813d0e00, rc 0) 00000100:00100000:3.0:1788797039.079383:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984660480:12345-0@lo:101:mount.lustre.0 Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.079390:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797039.079532:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797039.079546:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.079554:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797039.079607:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797039.079633:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.079661:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.079753:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660608 00000100:00100000:2.0:1788797039.079758:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660608 00000100:00100000:2.0:1788797039.079782:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797039.079788:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984660608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797039.079914:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984660608:12345-0@lo:501:mount.lustre.0 Request processed in 126us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.079921:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797039.079995:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797039.080024:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797039.080062:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.080087:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e409c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.080142:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660736 00000100:00100000:2.0:1788797039.080151:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660736 00000100:00100000:2.0:1788797039.080168:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797039.080175:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984660736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797039.080265:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984660736:12345-0@lo:503:mount.lustre.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.080272:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788797039.080351:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984660736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797039.081145:0:22816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22816:1875688984660864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797039.081190:0:22816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.081220:0:22816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.081271:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660864 00000100:00100000:2.0:1788797039.081276:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660864 00000100:00100000:2.0:1788797039.081312:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788797039.081318:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22816:x1875688984660864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797039.081825:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22816:x1875688984660864:12345-0@lo:502:llog_process_th.0 Request processed in 505us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.081833:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788797039.081925:0:22816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22816:1875688984660864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797039.081950:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797039.081961:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.081963:0:22816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788797039.081970:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb4b9fd8800 00000020:00000080:0.0:1788797039.081973:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797039.081981:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797039.081983:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.081985:0:22816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788797039.081987:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797039.081989:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.081990:0:22816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788797039.081993:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb4b9fd8800 00000020:00000080:0.0:1788797039.081995:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797039.082056:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797039.082059:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.082061:0:22816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788797039.082063:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797039.082065:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.082066:0:22816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788797039.082069:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb4b9fd8800 00000020:00000080:0.0:1788797039.082071:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788797039.082087:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797039.082089:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.082091:0:22816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788797039.082093:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797039.082095:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.082096:0:22816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788797039.082107:0:22816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb4b9fd8800 00000020:00000080:0.0:1788797039.082109:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788797039.082148:0:22816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22816:1875688984660992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797039.082185:0:22816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.082205:0:22816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.083532:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984660992 00000100:00100000:3.0:1788797039.083545:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984660992 00000100:00100000:3.0:1788797039.083589:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788797039.083600:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22816:x1875688984660992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797039.083763:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22816:x1875688984660992:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.083771:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797039.084154:0:22816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22816:1875688984660992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788797039.084186:0:22816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797039.084193:0:22816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797039.084194:0:22816:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788797039.084198:0:22816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788797039.084439:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788797039.084465:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797039.084487:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084498:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797039.084558:0:22766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788797039.084569:0:22766:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fb4b9fd8800 10000000:01000000:3.0:1788797039.084572:0:22766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fb4b9fd8800 10000000:01000000:3.0:1788797039.084576:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797039.084582:0:22766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fb4b9fd8800 from 1 10000000:01000000:3.0:1788797039.084585:0:22766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788797039.084623:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084632:0:22766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084642:0:22766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797039.084664:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797039.084752:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797039.084781:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661120 00000100:00100000:3.0:1788797039.084785:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661120 00000100:00100000:3.0:1788797039.084810:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797039.084817:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22766:x1875688984661120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797039.084828:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797039.084841:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4813d1600/0x500835b7bd2662e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2662dc expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084862:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4813d1600/0x500835b7bd2662e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2662dc expref: 12 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084873:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4813d1600/0x500835b7bd2662e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662dc expref: 12 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084891:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4813d1600, rc 0) 00000100:00100000:3.0:1788797039.084918:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984661120:12345-0@lo:101:mount.lustre.0 Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.084924:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797039.084960:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3818b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.084974:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797039.084987:0:22766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662e3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.084997:0:22766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2662e3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797039.085043:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797039.085066:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797039.085085:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661248 00000100:00100000:3.0:1788797039.085089:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661248 00000100:00100000:3.0:1788797039.085106:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797039.085111:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984661248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797039.085223:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984661248:12345-0@lo:501:mount.lustre.0 Request processed in 111us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.085230:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797039.085251:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3818b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.085261:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797039.085286:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797039.085327:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797039.085346:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661376 00000100:00100000:3.0:1788797039.085350:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661376 00000100:00100000:3.0:1788797039.088514:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797039.088533:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984661376:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797039.088718:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984661376:12345-0@lo:503:mount.lustre.0 Request processed in 191us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.088742:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797039.088800:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3818b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.088825:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984661376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797039.100849:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797039.101173:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797039.105878:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb48a4ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.108830:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661504 00000100:00100000:2.0:1788797039.108847:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661504 00000100:00100000:2.0:1788797039.108907:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797039.108917:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797039.109099:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661504:12345-0@lo:502:llog_process_th.0 Request processed in 184us (7926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.109107:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788797039.109220:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661504:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788797039.109289:0:22818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788797039.109305:0:22818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8fb4bfa28000) 00000020:00000080:1.0:1788797039.109329:0:22818:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788797039.109438:0:22818:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4b9fd8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788797039.109442:0:22818:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb4b9fd8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788797039.109444:0:22818:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb4b9fd8800 4 00010000:00080000:1.0:1788797039.109484:0:22818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb4a0088000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1788797039.111130:0:22818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788797039.111323:0:22818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788797039.111364:0:22818:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788797039.111378:0:22818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x500835b7bd2662f1 00000100:00080000:1.0:1788797039.111389:0:22818:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797039.111400:0:22818:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fb4a0088000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797039.111440:0:22818:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecca80 x1875688984661632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797039.111466:0:22818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788797039.112130:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984661632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797039.112203:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797039.112282:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661632 00000100:00100000:0.0:1788797039.112290:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661632 00000100:00100000:0.0:1788797039.112318:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797039.112326:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984661632:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797039.112394:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875688984661632:12345-0@lo:38:llog_process_th.0 Request processed in 67us (189us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788797039.112400:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797039.112439:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797039.112447:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4a0088000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797039.112451:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788797039.112455:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984661632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797039.128553:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788797039.128647:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797039.128721:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b161fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.129283:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661760 00000100:00100000:3.0:1788797039.129292:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661760 00000100:00100000:3.0:1788797039.129336:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788797039.129346:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788797039.129859:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661760:12345-0@lo:502:llog_process_th.0 Request processed in 512us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.129868:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797039.131873:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797039.131964:0:22818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788797039.132036:0:22818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797039.132154:0:22818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb48a4ac000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.137246:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984661888 00000100:00100000:2.0:1788797039.137260:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984661888 00000100:00100000:2.0:1788797039.137318:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797039.137330:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788797039.138071:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22818:x1875688984661888:12345-0@lo:502:llog_process_th.0 Request processed in 740us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797039.138086:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797039.138185:0:22818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943c4c9d-8ce2-4132-a4c5-0a007618de16:22818:1875688984661888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788797039.138221:0:22818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788797039.138393:0:22766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788797039.138416:0:22766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788797039.138435:0:22766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662e3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.138446:0:22766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4813d0c00/0x500835b7bd2662dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2662e3 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788797039.138495:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788797039.138497:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797039.138502:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797039.138504:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797039.138505:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797039.138506:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797039.138507:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797039.138508:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797039.138510:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797039.138511:0:22766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797039.138515:0:22766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788797039.138517:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797039.138518:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788797039.138519:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797039.138520:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797039.138521:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797039.138522:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797039.138523:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797039.138524:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788797039.138524:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797039.138525:0:22766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797039.138547:0:22766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788797039.138562:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984662016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797039.138599:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797039.138671:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797039.138998:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662016 00000100:00100000:2.0:1788797039.139004:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662016 00000100:00100000:2.0:1788797039.139046:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797039.139055:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984662016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788797039.139076:0:22782:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788797039.139089:0:22782:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788797039.146660:0:22782:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788797039.146704:0:22782:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788797039.146860:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788797039.146866:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788797039.146888:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.146905:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.146914:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.146952:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.146966:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797039.146981:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984662144:0@lo:104: 00000100:00100000:1.0:1788797039.147041:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797039.147079:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb48a4ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797039.147284:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662144 00000100:00100000:0.0:1788797039.147292:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662144 00000100:00100000:0.0:1788797039.147334:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797039.147342:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984662144:12345-0@lo:104: 00010000:00010000:0.0:1788797039.147364:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797039.148015:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22766:x1875688984662016:12345-0@lo:253:mount.lustre.0 Request processed in 8958us (9412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797039.148025:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788797039.148114:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:22766:1875688984662016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788797039.148126:0:22766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788797039.148129:0:22766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788797039.148131:0:22766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788797039.148133:0:22766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788797039.148145:0:22766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788797039.148146:0:22766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788797039.148148:0:22766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788797039.148149:0:22766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788797039.148150:0:22766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788797039.148152:0:22766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788797039.148154:0:22766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788797039.148170:0:22766:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788797039.152808:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984662144:0@lo:104: 00010000:00010000:2.0:1788797039.152840:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.156869:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788797039.156893:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984662144:12345-0@lo:104: Request processed in 9545us (9845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797039.156906:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788797039.157453:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797039.157463:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.157475:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797039.157479:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.157490:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797039.157499:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797039.157523:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797039.157581:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.157589:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788797039.157678:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984662272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797039.157782:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797039.157908:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.157916:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0800/0x500835b7bd2662c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662c7 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.157936:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797039.157938:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797039.157940:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797039.157968:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662272 00000100:00100000:3.0:1788797039.157976:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662272 00010000:00010000:3.0:1788797039.158003:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797039.158030:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788797039.158038:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3654:x1875688984662272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797039.158050:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797039.158055:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158066:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158081:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd2662c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2662c0 expref: 12 pid: 22782 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158101:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158108:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788797039.158122:0:22772:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011257707s 00010000:00010000:3.0:1788797039.158128:0:22772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158134:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158141:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158148:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158154:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797039.158158:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158166:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158180:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797039.158192:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797039.160163:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.160179:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797039.160186:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2662f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797039.164249:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:3654:x1875688984662272:12345-0@lo:103:ldlm_bl.0 Request processed in 6204us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.164264:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797039.174637:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984662272:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788797039.181985:0:22766:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1788797039.182274:0:22766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788797039.182612:0:22828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788797039.182831:0:22766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1788797039.183135:0:22827:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1788797039.183140:0:22827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:1.0:1788797039.183314:0:22828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788797039.184647:0:22829:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8fb3881a3480 x1875688984662400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797039.184660:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000040:01000000:0.0:1788797039.185022:0:22766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788797039.185072:0:22766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788797039.185558:0:22766:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788797039.185565:0:22766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788797039.185602:0:22766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797039.186749:0:22766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788797039.187264:0:22766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788797039.187295:0:22766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788797039.188894:0:22828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788797039.188975:0:22828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788797039.191965:0:22766:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788797039.193957:0:22766:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788797039.200077:0:22766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788797039.205922:0:22766:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788797039.205958:0:22766:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1ee01c73988 00100000:10000000:1.0:1788797039.205966:0:22766:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788797039.207008:0:22766:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788797039.207026:0:22766:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788797039.207047:0:22766:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788797039.207068:0:22766:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788797039.215545:0:22766:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797039.215778:0:22766:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797039.764881:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797039.832086:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788797039.832094:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb4b9fd8800 from 11 10000000:01000000:2.0:1788797039.832100:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797039.832150:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.832164:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.832185:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797039.832217:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984662528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797039.832290:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797039.833969:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b161f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797039.834406:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662528 00000100:00100000:1.0:1788797039.834416:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662528 00000100:00100000:1.0:1788797039.834477:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797039.834486:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+11:22784:x1875688984662528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797039.834503:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797039.834522:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2662ff expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.834547:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2662ff expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.834566:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662ff expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797039.834575:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb3881c5600, rc 0) 00000100:00100000:1.0:1788797039.834633:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22784:x1875688984662528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797039.834640:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788797039.834819:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984662528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797039.834836:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.834846:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797039.834908:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984662656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788797039.834946:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797039.834970:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b161f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788797039.835165:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662656 00000100:00100000:3.0:1788797039.835170:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662656 00000100:00100000:3.0:1788797039.835206:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797039.835213:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22784:x1875688984662656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788797039.835226:0:22782:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788797039.835242:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788797039.835245:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788797039.835332:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:22784:x1875688984662656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797039.835339:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788797039.839556:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984662656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788797039.839625:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788797039.839636:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797039.839648:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797040.151828:0:22823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788797040.151841:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788797040.155208:0:22823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788797040.155275:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788797040.211922:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788797040.789436:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797041.172501:0:22823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788797041.172513:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797041.172657:0:22823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788797041.172735:0:22823:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788797041.172899:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788797041.237063:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797041.812777:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797042.259951:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788797042.837112:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797043.286935:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797043.859889:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797044.307787:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000100:00080000:3.0:1788797044.500948:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797044.500956:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788797044.500959:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797044.500968:0:505:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:3.0:1788797044.500973:0:505:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797044.500985:0:505:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797044.501009:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a1500 x1875688984662912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797044.501024:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797044.501027:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797044.501036:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797044.501039:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797044.501041:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797044.501044:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788797044.501046:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb4a0088000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797044.501053:0:505:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fb4a0088000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797044.501065:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a2a00 x1875688984663040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797044.501127:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797044.501140:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984662784:0@lo:400:kworker.0 00000100:00100000:2.0:1788797044.501206:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797044.501260:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984662912:0@lo:38:kworker.0 00000100:00100000:2.0:1788797044.501306:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797044.501328:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984663040:0@lo:38:kworker.0 00000100:00100000:2.0:1788797044.501355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797044.501401:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662912 00000100:00100000:2.0:1788797044.501423:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662912 00000100:00100000:2.0:1788797044.501457:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797044.501464:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984662912:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788797044.501482:0:22793:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788797044.501528:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984662912:12345-0@lo:38:kworker.0 Request processed in 63us (222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797044.501534:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797044.501572:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797044.501576:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797044.501579:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984662912:0@lo:38:kworker.0 00000100:00100000:0.0:1788797044.501739:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663040 00000100:00100000:0.0:1788797044.501744:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663040 00000100:00100000:0.0:1788797044.501770:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797044.501775:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1875688984663040:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788797044.501795:0:22789:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:0.0:1788797044.501841:0:22789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x500835b7bd26630d 00000004:00100000:0.0:1788797044.501859:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788797044.502007:0:22789:0:(import.c:65:import_set_state_nolock()) ffff8fb497141000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797044.502058:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875688984663040:12345-0@lo:38:kworker.0 Request processed in 282us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797044.502065:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797044.502229:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662784 00000100:00100000:3.0:1788797044.502234:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662784 00000100:00100000:3.0:1788797044.502290:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788797044.502298:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3654:x1875688984662784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797044.502341:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3654:x1875688984662784:12345-0@lo:400:kworker.0 Request processed in 44us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797044.502347:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788797044.502566:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984662784:0@lo:400:kworker.0 00010000:00080000:2.0:1788797044.502601:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb3881a2a00 x1875688984663040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797044.502614:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788797044.502622:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788797044.502627:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797044.502629:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4a0088000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797044.502655:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875688984663040:0@lo:38:kworker.0 00000001:02000400:0.0:1788797044.871362:0:23071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788797044.890787:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797045.343878:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000020:00000004:2.0:1788797045.848835:0:23123:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797045.849061:0:23123:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797045.910002:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797046.355777:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000020:00000004:3.0:1788797046.842045:0:23174:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788797046.842269:0:23174:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797046.933170:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797047.379774:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797047.955840:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797048.404435:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788797048.980069:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797049.430340:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788797049.624286:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797039/real 1788797039] req@ffff8fb4b9eced80 x1875688984659968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797049.624316:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4b9eced80 x1875688984659968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797049.624325:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797039/real 1788797039] req@ffff8fb3881a3b80 x1875688984659840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797049.624345:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a3b80 x1875688984659840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788797049.624364:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797049.627837:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797049.627848:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659968:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788797049.627861:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797049.627869:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788797049.627872:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984659840:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788797049.629014:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788797049.629087:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797049.629092:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788797049.629096:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797049.629103:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 760 00000100:00080000:3.0:1788797049.629109:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788797049.629129:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797049.629167:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a1f80 x1875688984663296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797049.629295:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797049.629299:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797049.629301:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797049.629304:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:3.0:1788797049.629307:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797049.629313:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fb49000d800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797049.629328:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a1880 x1875688984663424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797049.629338:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797049.629340:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797049.629342:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797049.629346:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:3.0:1788797049.629348:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797049.629352:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797049.629363:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a1180 x1875688984663552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797049.629412:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663296:0@lo:38:kworker.0 00000100:00100000:1.0:1788797049.629475:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797049.629532:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663424:0@lo:8:kworker.0 00000400:00000100:1.0:1788797049.629565:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984663424 offset 0 length 520: 4 00000100:00100000:1.0:1788797049.629586:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663552:0@lo:8:kworker.0 00000400:00000100:1.0:1788797049.629604:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984663552 offset 0 length 520: 4 00000100:00100000:2.0:1788797049.630304:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663296 00000100:00100000:2.0:1788797049.630314:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663296 00000100:00100000:2.0:1788797049.630353:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788797049.630361:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984663296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788797049.630379:0:22793:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788797049.630431:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984663296:12345-0@lo:38:kworker.0 Request processed in 70us (955us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797049.630437:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788797049.630479:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797049.630493:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797049.630496:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663296:0@lo:38:kworker.0 00000100:00100000:0.0:1788797049.631333:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984663680:0@lo:400:kworker.0 00000100:00100000:0.0:1788797049.631384:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797049.631418:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984663168:0@lo:400:kworker.0 00000100:00100000:0.0:1788797049.631475:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797049.631659:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663680 00000100:00100000:2.0:1788797049.631666:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663680 00000100:00100000:2.0:1788797049.631722:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797049.631730:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984663680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797049.631780:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984663680:12345-0@lo:400:kworker.0 Request processed in 52us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797049.631786:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788797049.631814:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb3881a0380 x1875688984663680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797049.631827:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984663680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797049.632074:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663168 00000100:00100000:1.0:1788797049.632079:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663168 00000100:00100000:1.0:1788797049.632113:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797049.632120:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3657:x1875688984663168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797049.632169:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3657:x1875688984663168:12345-0@lo:400:kworker.0 Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797049.632187:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797049.632233:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984663168:0@lo:400:kworker.0 00010000:00010000:1.0:1788797050.005852:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797050.453249:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797051.028631:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797051.412437:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788797051.476628:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788797052.054946:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797052.499925:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797053.076644:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797053.531286:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788797054.116619:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797054.548836:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00000100:00080000:1.0:1788797054.740605:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788797054.740613:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788797054.740617:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797054.740625:0:21075:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 765 00000100:00080000:1.0:1788797054.740632:0:21075:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788797054.740654:0:21075:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1788797054.740655:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984663808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797054.740704:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9eced80 x1875688984663936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797054.740723:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797054.740726:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797054.740746:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797054.740749:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797054.740763:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797054.740815:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797054.740821:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984664064:0@lo:400:kworker.0 00000100:00100000:3.0:1788797054.740826:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663936:0@lo:38:kworker.0 00000100:00100000:2.0:1788797054.740853:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797054.740881:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797054.740941:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663808 00000100:00100000:2.0:1788797054.740950:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663808 00000100:00100000:2.0:1788797054.741007:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797054.741217:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3654:x1875688984663808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797054.741279:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:3654:x1875688984663808:12345-0@lo:400:kworker.0 Request processed in 263us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797054.741287:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797054.741317:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984663936 00000100:00100000:2.0:1788797054.741320:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984663936 00000100:00100000:2.0:1788797054.741336:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797054.741341:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984663936:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788797054.741356:0:22793:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788797054.741386:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984663936:12345-0@lo:38:kworker.0 Request processed in 44us (505us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797054.741392:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788797054.741426:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797054.741430:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797054.741434:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663936:0@lo:38:kworker.0 00000100:00100000:3.0:1788797054.741534:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984663808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797054.748847:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664064 00000100:00100000:1.0:1788797054.748863:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664064 00000100:00100000:1.0:1788797054.753156:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797054.753181:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984664064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797054.753288:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984664064:12345-0@lo:400:kworker.0 Request processed in 119us (12433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797054.753296:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788797054.753511:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb4b9ecd880 x1875688984664064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797054.753528:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984664064:0@lo:400:kworker.0 00000020:01000004:1.0:1788797054.951414:0:23520:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788797054.951418:0:23520:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788797054.951420:0:23520:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788797054.951549:0:23520:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fb488901800 00000020:01000004:1.0:1788797054.951565:0:23520:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788797054.951576:0:23520:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788797054.951590:0:23520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8fb4bfa2b370) 00000020:00000080:1.0:1788797054.951605:0:23520:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788797055.005517:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788797055.006549:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.019997:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.020539:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.020952:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.021962:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.022302:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.022519:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.022738:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.022984:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.023231:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.023652:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.023965:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.024244:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.024575:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.024954:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.025214:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.025527:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.026284:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.026655:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.028157:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.029713:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.031388:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.032197:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.032528:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.032840:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.034157:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.034646:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.035547:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788797055.036855:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.037150:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788797055.037478:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788797055.037984:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788797055.038929:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788797055.040625:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788797055.041190:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797055.041652:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.042125:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788797055.042495:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.042886:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.043179:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797055.043535:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.044039:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788797055.044456:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.044818:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788797055.045038:0:23520:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788797055.047055:0:23520:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788797055.047304:0:23520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788797055.047316:0:23520:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788797055.047330:0:23520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd26631b 00000020:01000004:3.0:1788797055.047339:0:23520:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788797055.047362:0:23520:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788797055.047365:0:23520:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788797055.047371:0:23520:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788797055.047398:0:23520:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788797055.047402:0:23520:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788797055.057134:0:23520:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797055.057186:0:23520:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.127@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788797055.057192:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797055.057193:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788797055.057195:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797055.057196:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797055.057197:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797055.057204:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797055.057205:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797055.057207:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797055.057208:0:23520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797055.057212:0:23520:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788797055.057215:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797055.057216:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788797055.057217:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797055.057218:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797055.057219:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797055.057220:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797055.057221:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797055.057222:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797055.057223:0:23520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797055.057256:0:23520:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788797055.057277:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797055.057369:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.057423:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.058038:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664192 00000100:00100000:0.0:1788797055.058048:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664192 00000100:00100000:0.0:1788797055.058104:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788797055.058115:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:23520:x1875688984664192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797055.058148:0:22779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788797055.058151:0:22779:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788797055.058165:0:22779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788797055.058788:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:23520:x1875688984664192:12345-0@lo:253:mount.lustre.0 Request processed in 672us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.058797:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788797055.059197:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788797055.059210:0:23520:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788797055.059213:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788797055.059215:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788797055.059216:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797055.059217:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797055.059218:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797055.059219:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797055.059220:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797055.059222:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797055.059223:0:23520:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788797055.059249:0:23520:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fb488901800 from lustre-MDT0001 10000000:01000000:3.0:1788797055.059277:0:23520:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788797055.059279:0:23520:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788797055.059286:0:23520:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fb3875b3370 local copy 00010000:00010000:3.0:1788797055.059296:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797055.059410:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797055.059460:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.059500:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.059674:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664320 00000100:00100000:2.0:1788797055.059714:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664320 00000100:00100000:2.0:1788797055.059860:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788797055.059869:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:23520:x1875688984664320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797055.059941:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:23520:x1875688984664320:12345-0@lo:501:mount.lustre.0 Request processed in 74us (494us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797055.059948:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797055.060203:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788797055.060219:0:23520:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788797055.060241:0:23520:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788797055.060247:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.060256:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.060281:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fb488901800 10000000:01000000:1.0:1788797055.060285:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788797055.060299:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fb3875b3370 10000000:01000000:1.0:1788797055.060302:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788797055.060306:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fb3875b3370 from 1 10000000:01000000:1.0:1788797055.060309:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788797055.060337:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.060344:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.060354:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.060369:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797055.060400:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.060656:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.061527:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664448 00000100:00100000:3.0:1788797055.061536:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664448 00000100:00100000:3.0:1788797055.065993:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797055.066036:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+12:23520:x1875688984664448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797055.066062:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797055.066314:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4813d1200/0x500835b7bd266329 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266322 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.066353:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4813d1200/0x500835b7bd266329 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266322 expref: 13 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.066366:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4813d1200/0x500835b7bd266329 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266322 expref: 13 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.066376:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4813d1200, rc 0) 00000100:00100000:3.0:1788797055.066488:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+13:23520:x1875688984664448:12345-0@lo:101:mount.lustre.0 Request processed in 478us (6085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.066494:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788797055.066602:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797055.066623:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266329 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.066632:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266329 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.066658:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788797055.066705:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266329 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.066714:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4a00/0x500835b7bd266322 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266329 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.066758:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fb488901800 10000000:01000000:1.0:1788797055.066763:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788797055.066768:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fb488901800 from 1 10000000:01000000:1.0:1788797055.066770:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788797055.066800:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.066808:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.066816:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.066838:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797055.066875:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.069519:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.073487:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664576 00000100:00100000:2.0:1788797055.073504:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664576 00000100:00100000:2.0:1788797055.073580:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788797055.073592:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+13:23520:x1875688984664576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797055.073613:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797055.073637:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29c000/0x500835b7bd266337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266330 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.073672:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29c000/0x500835b7bd266337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266330 expref: 14 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.073701:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29c000/0x500835b7bd266337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266330 expref: 14 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.073710:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29c000, rc 0) 00000100:00100000:2.0:1788797055.073794:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+14:23520:x1875688984664576:12345-0@lo:101:mount.lustre.0 Request processed in 205us (6918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.073801:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788797055.073812:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797055.073831:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266337 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.073841:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266337 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.073858:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788797055.073871:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266337 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.073880:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5800/0x500835b7bd266330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266337 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.073897:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788797055.073901:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788797055.073908:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fb488901800 10000000:01000000:1.0:1788797055.073910:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788797055.073915:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788797055.073917:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788797055.073942:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.073950:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.073958:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.073977:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797055.074010:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.074050:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.074983:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664704 00000100:00100000:2.0:1788797055.074991:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664704 00000100:00100000:2.0:1788797055.075019:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797055.075025:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+14:23520:x1875688984664704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797055.075035:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797055.075046:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd266345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26633e expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.075064:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd266345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26633e expref: 15 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.075073:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29ce00/0x500835b7bd266345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26633e expref: 15 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.075081:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29ce00, rc 0) 00000100:00100000:2.0:1788797055.075127:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984664704:12345-0@lo:101:mount.lustre.0 Request processed in 102us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.075135:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788797055.076414:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797055.076440:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266345 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.076460:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266345 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797055.079656:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1788797055.080922:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797055.086911:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788797055.087301:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1788797055.087322:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1788797055.087340:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1788797055.087354:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1788797055.087368:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1788797055.087383:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1788797055.087396:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1788797055.087408:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1788797055.087422:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1788797055.087436:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1788797055.087524:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1788797055.087542:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1788797055.087638:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1788797055.087652:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1788797055.087663:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1788797055.087675:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1788797055.087718:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1788797055.087808:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1788797055.087827:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1788797055.087841:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1788797055.087855:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1788797055.087870:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1788797055.087884:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1788797055.087901:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1788797055.087916:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1788797055.087931:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1788797055.087944:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1788797055.087956:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1788797055.087967:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1788797055.087976:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1788797055.087989:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1788797055.088002:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1788797055.088016:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1788797055.088057:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1788797055.088072:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1788797055.088213:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1788797055.088373:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1788797055.088394:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1788797055.088410:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1788797055.088424:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1788797055.088437:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1788797055.088465:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1788797055.088485:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1788797055.088516:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1788797055.088522:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1788797055.089370:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797055.089461:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.089519:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.089636:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664832 00000100:00100000:2.0:1788797055.089645:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664832 00000100:00100000:2.0:1788797055.089714:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797055.089724:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984664832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797055.089895:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984664832:12345-0@lo:501:mount.lustre.0 Request processed in 172us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.089903:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788797055.089944:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797055.089979:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797055.090156:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.090222:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.090262:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984664960 00000100:00100000:0.0:1788797055.090267:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984664960 00000100:00100000:0.0:1788797055.090331:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788797055.090339:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984664960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797055.091175:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984664960:12345-0@lo:503:mount.lustre.0 Request processed in 835us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.091183:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788797055.091267:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984664960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788797055.091788:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797055.091862:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797055.091906:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.092292:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.092472:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665088 00000100:00100000:3.0:1788797055.092478:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665088 00000100:00100000:3.0:1788797055.092509:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788797055.092516:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984665088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.093517:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984665088:12345-0@lo:502:mount.lustre.0 Request processed in 997us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.093533:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788797055.093865:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797055.094197:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788797055.094231:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1788797055.094257:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1788797055.094274:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1788797055.094293:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1788797055.094308:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1788797055.094321:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1788797055.094335:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1788797055.094349:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1788797055.094363:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1788797055.094376:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1788797055.094388:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1788797055.094403:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1788797055.094418:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1788797055.094432:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1788797055.094458:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1788797055.094475:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1788797055.094491:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1788797055.094507:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1788797055.094522:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1788797055.094536:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1788797055.094634:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1788797055.094654:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1788797055.094670:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1788797055.094834:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1788797055.094854:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1788797055.094870:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1788797055.094885:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1788797055.094900:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1788797055.094915:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1788797055.094929:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1788797055.094944:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1788797055.094960:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1788797055.094976:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1788797055.094990:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1788797055.095017:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1788797055.095176:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1788797055.095194:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1788797055.095209:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1788797055.095223:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1788797055.095237:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1788797055.095251:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1788797055.095266:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1788797055.095281:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1788797055.095321:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797055.095387:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.095491:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.095542:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665216 00000100:00100000:0.0:1788797055.095618:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665216 00000100:00100000:0.0:1788797055.095912:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788797055.095923:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984665216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797055.096049:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984665216:12345-0@lo:502:mount.lustre.0 Request processed in 128us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.096056:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788797055.096147:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797055.096200:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788797055.096211:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788797055.097783:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797055.097796:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.097799:0:23524:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788797055.097805:0:23524:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788797055.097808:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797055.097824:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8fb4bfa2cd28) 00000020:00000080:1.0:1788797055.097846:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788797055.097853:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788797055.097948:0:23524:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788797055.097955:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd266353 00000020:00000080:1.0:1788797055.098326:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788797055.098331:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797055.098335:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.098336:0:23524:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788797055.098339:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797055.098342:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.098349:0:23524:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788797055.098353:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797055.098360:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8fb498b2b370) 00000020:00000080:1.0:1788797055.098371:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788797055.098375:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788797055.098377:0:23524:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788797055.098379:0:23524:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788797055.098385:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788797055.098426:0:23524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb488901800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788797055.098436:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8fb498b299b8) 00000020:00000080:1.0:1788797055.098455:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788797055.098518:0:23524:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788797055.098523:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd266368 00000020:00000080:1.0:1788797055.098676:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788797055.098706:0:23524:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788797055.098710:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x500835b7bd26636f 00080000:01000000:1.0:1788797055.098715:0:23524:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788797055.098718:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd266376 00010000:00010000:3.0:1788797055.127671:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797055.165292:0:23524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788797055.171983:0:23524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788797055.174471:0:23524:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788797055.176850:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788797055.176865:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797055.176872:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.176874:0:23524:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788797055.176881:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797055.176887:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.176889:0:23524:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788797055.176893:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788797055.176898:0:23524:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:00000080:0.0:1788797055.176928:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797055.176943:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8fb4bafe0000) 00000020:00000080:0.0:1788797055.176976:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788797055.176983:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788797055.177090:0:23524:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788797055.177097:0:23524:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788797055.177104:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd266384 00010000:00080000:0.0:1788797055.177133:0:23524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb3883fe000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.127@tcp at head 00010000:00010000:0.0:1788797055.179992:0:23524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788797055.181892:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788797055.181906:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788797055.181943:0:23524:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788797055.181965:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd26638b 00000100:00080000:0.0:1788797055.181974:0:23524:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788797055.181986:0:23524:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8fb3883fe000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788797055.182169:0:23524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd7480 x1875688984665344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797055.182194:0:23524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788797055.182240:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797055.182244:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182245:0:23524:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788797055.182248:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788797055.182251:0:23524:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788797055.182253:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797055.182254:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797055.182256:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788797055.182258:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182259:0:23524:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788797055.182261:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797055.182265:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182266:0:23524:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788797055.182269:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788797055.182297:0:23524:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788797055.182318:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797055.182321:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182322:0:23524:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788797055.182324:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788797055.182326:0:23524:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788797055.182327:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797055.182329:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788797055.182330:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788797055.182332:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182333:0:23524:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788797055.182335:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788797055.182339:0:23524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788797055.182342:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797055.182343:0:23524:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788797055.182345:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788797055.182349:0:23524:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:0.0:1788797055.182369:0:23524:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788797055.182371:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797055.182383:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8fb4bafe3370) 00000020:00000080:0.0:1788797055.182393:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788797055.182397:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788797055.183012:0:23524:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788797055.183123:0:23524:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788797055.183131:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd266399 00010000:00080000:0.0:1788797055.183161:0:23524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb4bd330800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.127@tcp at head 00010000:00010000:0.0:1788797055.184340:0:23524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788797055.184829:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788797055.184903:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788797055.186329:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797055.186337:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797055.186340:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797055.186343:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797055.186429:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665344 00000100:00100000:2.0:1788797055.186439:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665344 00000100:00100000:2.0:1788797055.186501:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797055.186509:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3653:x1875688984665344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797055.186963:0:22793:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:2.0:1788797055.187003:0:22793:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd2663a0 00000040:01000000:0.0:1788797055.187348:0:23524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00100000:2.0:1788797055.187814:0:22793:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788797055.187822:0:22793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1788797055.188629:0:23524:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788797055.196500:0:23524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797055.198330:0:23524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788797055.198503:0:23524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788797055.199642:0:23529:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788797055.199649:0:23529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1788797055.200113:0:22793:0:(import.c:65:import_set_state_nolock()) ffff8fb38769b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797055.200213:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875688984665344:12345-0@lo:38:llog_process_th.0 Request processed in 13702us (15308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.200224:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797055.200310:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797055.200320:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788797055.200335:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788797055.200340:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788797055.200344:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797055.200365:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797055.200558:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797055.200572:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984665472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797055.200611:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797055.200837:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665472 00000100:00100000:2.0:1788797055.200846:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665472 00000100:00100000:2.0:1788797055.200892:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797055.200901:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1875688984665472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797055.200930:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797055.200970:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1875688984665472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.200976:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797055.201036:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984665472:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788797055.202214:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788797055.202228:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797055.202267:0:23524:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788797055.202293:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd2663a7 00000100:00080000:1.0:1788797055.202301:0:23524:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797055.202312:0:23524:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fb4bd330800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797055.202341:0:23524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecca80 x1875688984665600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797055.202371:0:23524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788797055.202434:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797055.202439:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.202441:0:23524:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788797055.202459:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788797055.202462:0:23524:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788797055.202464:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797055.202465:0:23524:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788797055.202467:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788797055.202470:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.202471:0:23524:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788797055.202474:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788797055.202479:0:23524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788797055.202482:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.202483:0:23524:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788797055.202487:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788797055.202491:0:23524:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.127@tcp to nid 0x20000c0a8c97f (192.168.201.127@tcp) 00000020:01000000:1.0:1788797055.202515:0:23524:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788797055.202518:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788797055.202530:0:23524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8fb498b2cd28) 00000020:00000080:1.0:1788797055.202542:0:23524:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788797055.202627:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788797055.202860:0:23524:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788797055.202869:0:23524:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788797055.202875:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x500835b7bd2663b5 00010000:00080000:1.0:1788797055.202913:0:23524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb3883fc800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.127@tcp at head 00010000:00010000:1.0:1788797055.203147:0:23524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788797055.203220:0:23524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788797055.203236:0:23524:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788797055.203719:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.203725:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797055.203728:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.203743:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797055.203932:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665600:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788797055.203996:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984665600 offset 0 length 520: 4 00000040:00080000:1.0:1788797055.205887:0:23524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797055.206255:0:23524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788797055.206382:0:23524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1788797055.207273:0:23531:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788797055.207279:0:23531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788797055.208338:0:23524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788797055.208352:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788797055.208394:0:23524:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788797055.208419:0:23524:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd2663bc 00000100:00080000:1.0:1788797055.208430:0:23524:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788797055.208452:0:23524:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797055.208492:0:23524:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecdf80 x1875688984665728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788797055.208625:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665728:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788797055.208677:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984665728 offset 0 length 520: 4 00000100:00080000:1.0:1788797055.208935:0:23524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788797055.209240:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797055.209246:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.209248:0:23524:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788797055.209251:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797055.209255:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.209256:0:23524:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788797055.209259:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788797055.209261:0:23524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788797055.209264:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797055.209266:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.209267:0:23524:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788797055.209270:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788797055.209272:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.209274:0:23524:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788797055.209277:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788797055.209310:0:23524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788797055.209314:0:23524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788797055.209329:0:23524:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788797055.209334:0:23524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1788797055.209505:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.209510:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797055.209513:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.209516:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788797055.209647:0:23520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788797055.209720:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788797055.209842:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266345 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.209855:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5c00/0x500835b7bd26633e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266345 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797055.209863:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb488901800 from 1 10000000:01000000:2.0:1788797055.209866:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797055.209900:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.209907:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.209918:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797055.209936:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797055.209986:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797055.210012:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb48891d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.210047:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665856 00000100:00100000:2.0:1788797055.210053:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665856 00000100:00100000:2.0:1788797055.210105:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788797055.210114:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+15:23520:x1875688984665856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797055.210127:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797055.210140:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2663c3 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.210165:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 16 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.210187:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 16 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.210196:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29d800, rc 0) 00000100:00100000:2.0:1788797055.210238:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:23520:x1875688984665856:12345-0@lo:101:mount.lustre.0 Request processed in 125us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.210245:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788797055.210416:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797055.210430:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.210440:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.211033:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665984:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788797055.211094:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.211116:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4861083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.211482:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984665984 00000100:00100000:2.0:1788797055.211490:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984665984 00000100:00100000:2.0:1788797055.211530:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788797055.211539:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:23520:x1875688984665984:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788797055.211575:0:22779:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788797055.211594:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788797055.211598:0:22779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788797055.211722:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:23520:x1875688984665984:12345-0@lo:256:mount.lustre.0 Request processed in 184us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.211834:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788797055.211944:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984665984:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788797055.212809:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797055.213398:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.213411:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.213419:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb488901800 from 1 10000000:01000000:1.0:1788797055.213422:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797055.213469:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.213478:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.213488:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.213633:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797055.213716:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.213819:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4861083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.213894:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666112 00000100:00100000:2.0:1788797055.213901:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666112 00000100:00100000:2.0:1788797055.213946:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788797055.213954:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:23520:x1875688984666112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797055.213968:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797055.213980:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2663d1 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.214003:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.214194:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.214204:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29c600, rc 0) 00000100:00100000:2.0:1788797055.214249:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666112:12345-0@lo:101:mount.lustre.0 Request processed in 294us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.214256:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788797055.214330:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797055.214346:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.214355:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797055.215456:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788797055.216208:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797055.216393:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788797055.216421:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788797055.216438:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788797055.216466:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788797055.216483:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788797055.216500:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788797055.216515:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788797055.216528:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788797055.216542:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788797055.216641:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788797055.216658:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788797055.216675:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788797055.216948:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788797055.217053:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797055.217130:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.217180:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb486108000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.217301:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666240 00000100:00100000:2.0:1788797055.217310:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666240 00000100:00100000:2.0:1788797055.217365:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788797055.217374:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797055.217494:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666240:12345-0@lo:501:mount.lustre.0 Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.217502:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788797055.217891:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797055.217928:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797055.217972:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.217997:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb486108000 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.218043:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666368 00000100:00100000:2.0:1788797055.218048:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666368 00000100:00100000:2.0:1788797055.218173:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788797055.218181:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797055.218274:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666368:12345-0@lo:503:mount.lustre.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.218281:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788797055.218347:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788797055.218809:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797055.218870:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797055.218911:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.219431:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.219514:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666496 00000100:00100000:3.0:1788797055.219521:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666496 00000100:00100000:3.0:1788797055.219677:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788797055.219711:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.219855:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666496:12345-0@lo:502:mount.lustre.0 Request processed in 146us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.219863:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788797055.220094:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797055.220286:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788797055.220312:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788797055.220324:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788797055.220336:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788797055.220348:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1788797055.220361:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1788797055.220374:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1788797055.220388:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1788797055.220400:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788797055.220411:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1788797055.220424:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1788797055.220470:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797055.220519:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.220818:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e40b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.220887:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666624 00000100:00100000:3.0:1788797055.220893:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666624 00000100:00100000:3.0:1788797055.220919:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788797055.220926:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.221033:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666624:12345-0@lo:502:mount.lustre.0 Request processed in 98us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.221040:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788797055.221211:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797055.221260:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788797055.221278:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788797055.222153:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797055.222166:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222168:0:23533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788797055.222176:0:23533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb488901800 00000020:00000080:2.0:1788797055.222178:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797055.222193:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797055.222196:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222197:0:23533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788797055.222199:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797055.222201:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222203:0:23533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788797055.222206:0:23533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb488901800 00000020:00000080:2.0:1788797055.222208:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797055.222272:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797055.222277:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222278:0:23533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788797055.222281:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797055.222284:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222285:0:23533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797055.222288:0:23533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb488901800 00000020:00000080:2.0:1788797055.222290:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797055.222312:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797055.222315:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222316:0:23533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797055.222319:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797055.222321:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222323:0:23533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788797055.222326:0:23533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb488901800 00000020:00000080:2.0:1788797055.222327:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797055.222350:0:23533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797055.222353:0:23533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797055.222355:0:23533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788797055.222358:0:23533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788797055.222574:0:23520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788797055.222601:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797055.222626:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.222637:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797055.222712:0:23520:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788797055.222716:0:23520:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fb488901800 10000000:01000000:3.0:1788797055.222719:0:23520:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fb488901800 10000000:01000000:3.0:1788797055.222723:0:23520:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797055.222901:0:23520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fb488901800 from 1 10000000:01000000:3.0:1788797055.222906:0:23520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788797055.222941:0:23520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.222950:0:23520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.222959:0:23520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797055.222980:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797055.223048:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797055.223211:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666752 00000100:00100000:2.0:1788797055.223218:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666752 00000100:00100000:2.0:1788797055.223263:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788797055.223273:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:23520:x1875688984666752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797055.223286:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797055.223308:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29cc00/0x500835b7bd2663e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2663df expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.223329:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29cc00/0x500835b7bd2663e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2663df expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.223340:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29cc00/0x500835b7bd2663e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2663df expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797055.223349:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29cc00, rc 0) 00000100:00100000:3.0:1788797055.224334:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797055.228811:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984666752:12345-0@lo:101:mount.lustre.0 Request processed in 5531us (5754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797055.228826:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788797055.230207:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797055.230239:0:23520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663e6 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.230252:0:23520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2663e6 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797055.234837:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788797055.236359:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797055.237937:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788797055.237983:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788797055.238000:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788797055.238015:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788797055.238047:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788797055.238064:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788797055.238093:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788797055.238109:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788797055.238124:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788797055.238140:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788797055.238156:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788797055.238170:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788797055.238184:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788797055.238198:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788797055.238212:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788797055.238227:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788797055.238240:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788797055.238253:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788797055.238267:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788797055.238282:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788797055.238296:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788797055.238310:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788797055.238336:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788797055.238351:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788797055.238365:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788797055.238379:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788797055.238391:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788797055.238403:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788797055.238417:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788797055.238432:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788797055.238455:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788797055.238470:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788797055.238483:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788797055.238495:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788797055.238509:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788797055.238520:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788797055.238532:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788797055.241805:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788797055.241887:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788797055.241906:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788797055.241919:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788797055.241932:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788797055.241945:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788797055.241959:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788797055.241972:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788797055.241984:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788797055.241997:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788797055.242014:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788797055.243317:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788797055.243361:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788797055.243385:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788797055.243392:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788797055.245239:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797055.245306:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.248293:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4aaf4f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.249843:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984666880 00000100:00100000:0.0:1788797055.249860:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984666880 00000100:00100000:0.0:1788797055.251857:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788797055.251876:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984666880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797055.252095:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984666880:12345-0@lo:501:mount.lustre.0 Request processed in 225us (6787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.252104:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788797055.253211:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984666880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797055.253268:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797055.253326:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.257082:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667008 00000100:00100000:3.0:1788797055.257099:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667008 00000100:00100000:3.0:1788797055.257152:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788797055.257163:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797055.257312:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667008:12345-0@lo:503:mount.lustre.0 Request processed in 150us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.257319:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788797055.260241:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb491c2b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.260287:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797055.260868:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797055.260970:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.261059:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.261850:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667136 00000100:00100000:3.0:1788797055.261859:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667136 00000100:00100000:3.0:1788797055.261901:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797055.261911:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.262159:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667136:12345-0@lo:502:mount.lustre.0 Request processed in 248us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.262168:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797055.262225:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4aaf4f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.262249:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797055.262459:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788797055.262488:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788797055.262501:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788797055.262514:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788797055.262527:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788797055.263846:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788797055.263888:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788797055.263902:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788797055.263915:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788797055.263927:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788797055.263939:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788797055.263952:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788797055.263965:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788797055.263992:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788797055.264006:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788797055.264017:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788797055.264028:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788797055.264041:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788797055.264053:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788797055.264065:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788797055.264210:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788797055.264229:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788797055.264245:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788797055.264261:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788797055.264275:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788797055.264291:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788797055.264304:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788797055.264317:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788797055.264329:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788797055.264355:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788797055.264370:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788797055.264383:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788797055.264396:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788797055.264410:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788797055.264423:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788797055.264437:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788797055.264469:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788797055.264483:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788797055.264511:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788797055.264524:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788797055.264535:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788797055.265068:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788797055.265163:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788797055.265180:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788797055.265196:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788797055.265225:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788797055.265242:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788797055.265256:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788797055.265312:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.265390:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.265460:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667264 00000100:00100000:3.0:1788797055.265468:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667264 00000100:00100000:3.0:1788797055.265511:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788797055.265520:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.265955:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667264:12345-0@lo:502:mount.lustre.0 Request processed in 435us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.265963:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788797055.266814:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4aaf4f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788797055.266850:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797055.267168:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788797055.267195:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788797055.267228:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797055.267278:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.267308:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4aaf4f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.267673:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667392 00000100:00100000:0.0:1788797055.267701:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667392 00000100:00100000:0.0:1788797055.267822:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788797055.267831:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797055.267954:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984667392:12345-0@lo:502:mount.lustre.0 Request processed in 123us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.267961:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788797055.268664:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984667392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797055.268822:0:23520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788797055.268839:0:23520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788797055.278356:0:23538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788797055.278379:0:23538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8fb4bbe599b8) 00000020:00000080:2.0:1788797055.278405:0:23538:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788797055.280193:0:23538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb488901800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788797055.280204:0:23538:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb488901800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788797055.280207:0:23538:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb488901800 3 00010000:00080000:2.0:1788797055.280248:0:23538:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb484293000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1788797055.284493:0:23538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788797055.284763:0:23538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788797055.284812:0:23538:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797055.284827:0:23538:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x500835b7bd2663f4 00000100:00080000:2.0:1788797055.284837:0:23538:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797055.284850:0:23538:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8fb484293000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1788797055.284894:0:23538:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb387b92300 x1875688984667520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797055.284926:0:23538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788797055.285132:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875688984667520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788797055.285197:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788797055.285255:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797055.285259:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788797055.285262:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797055.285266:0:21075:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 770 00000100:00080000:3.0:1788797055.285268:0:21075:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788797055.285274:0:21075:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797055.285291:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a3100 x1875688984667648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797055.285312:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.285315:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797055.285318:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.285320:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797055.285355:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.285358:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797055.285361:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797055.285363:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797055.285389:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667520 00000100:00100000:3.0:1788797055.285396:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667520 00000100:00100000:3.0:1788797055.285429:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797055.285436:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1875688984667520:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788797055.285478:0:22789:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 771 last 0 00000020:00000080:3.0:1788797055.285508:0:22789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x500835b7bd2663fb 00000004:00100000:3.0:1788797055.285522:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788797055.285548:0:22789:0:(import.c:65:import_set_state_nolock()) ffff8fb4bab2e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797055.285592:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875688984667520:12345-0@lo:38:llog_process_th.0 Request processed in 155us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.285599:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797055.285622:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984667776:0@lo:400:kworker.0 00000100:00100000:3.0:1788797055.285650:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.285699:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984667904:0@lo:400:kworker.0 00000100:00100000:3.0:1788797055.285741:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.285775:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667776 00000100:00100000:3.0:1788797055.285779:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667776 00000100:00100000:3.0:1788797055.285806:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797055.285812:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984667776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797055.285846:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984667776:12345-0@lo:400:kworker.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.285852:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797055.285875:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667904 00000100:00100000:3.0:1788797055.285879:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667904 00000100:00100000:3.0:1788797055.285901:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797055.285907:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1875688984667904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797055.285941:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1875688984667904:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797055.285947:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788797055.285977:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb3881a0700 x1875688984667776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797055.285996:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984667776:0@lo:400:kworker.0 00000100:00100000:3.0:1788797055.286027:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984667904:0@lo:400:kworker.0 00000100:00100000:2.0:1788797055.287025:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984667648:0@lo:38:kworker.0 00000100:00100000:2.0:1788797055.287069:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788797055.287216:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb387b92300 x1875688984667520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797055.287226:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797055.287233:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788797055.287240:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788797055.287246:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788797055.287248:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb484293000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797055.287254:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875688984667520:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788797055.287366:0:23538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:1.0:1788797055.288668:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984667648 00000100:00100000:1.0:1788797055.288693:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984667648 00000100:00100000:1.0:1788797055.288740:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788797055.288747:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1875688984667648:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788797055.288823:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1875688984667648:12345-0@lo:38:kworker.0 Request processed in 74us (1752us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788797055.288829:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788797055.288868:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788797055.288874:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788797055.288878:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788797055.288881:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984667648:0@lo:38:kworker.0 00000020:01000000:3.0:1788797055.290434:0:23520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788797055.290487:0:23520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788797055.290505:0:23520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663e6 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797055.290518:0:23520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4813d1a00/0x500835b7bd2663df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2663e6 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788797055.292344:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788797055.292348:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788797055.292349:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797055.292350:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797055.292352:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797055.292355:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797055.292356:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797055.292358:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797055.292359:0:23520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797055.292363:0:23520:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788797055.292366:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797055.292368:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788797055.292369:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797055.292370:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797055.292371:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797055.292372:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797055.292373:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788797055.292374:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797055.292375:0:23520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788797055.292404:0:23520:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788797055.292424:0:23520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984668032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797055.292509:0:23520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797055.293817:0:23520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386715cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.295647:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668032 00000100:00100000:0.0:1788797055.295660:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668032 00000100:00100000:0.0:1788797055.295757:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788797055.295769:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:23520:x1875688984668032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797055.295816:0:22781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788797055.295829:0:22781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788797055.300361:0:22767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788797055.300453:0:22781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788797055.300467:0:22781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788797055.300540:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788797055.300555:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788797055.300579:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300601:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662ff expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300610:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 18 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300617:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300656:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 18 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300716:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 18 pid: 22782 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.300741:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984668160:0@lo:104: 00000100:00100000:1.0:1788797055.300817:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797055.300867:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.300875:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 18 pid: 22781 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.300882:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984668288:0@lo:104: 00000100:00100000:1.0:1788797055.300903:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.300921:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797055.300946:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668160 00000100:00100000:1.0:1788797055.300953:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668160 00000100:00100000:1.0:1788797055.300987:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668288 00000100:00100000:1.0:1788797055.300989:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668288 00000100:00100000:1.0:1788797055.301002:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797055.301009:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984668160:12345-0@lo:104: 00010000:00010000:1.0:1788797055.301033:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301085:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788797055.301091:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984668160:12345-0@lo:104: Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797055.301097:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797055.301115:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797055.301128:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984668288:12345-0@lo:104: 00010000:00010000:1.0:1788797055.301136:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301169:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788797055.301174:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984668288:12345-0@lo:104: Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797055.301180:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788797055.301198:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797055.301203:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301211:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29de00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788797055.301215:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301224:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788797055.301231:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.301237:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788797055.301266:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301273:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797055.301293:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301310:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd2663c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663ca expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301323:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797055.301326:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301332:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c400 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:1.0:1788797055.301335:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301342:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788797055.301348:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797055.301353:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788797055.301367:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301372:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797055.301388:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301394:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4be29c400/0x500835b7bd2662ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266306 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301406:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797055.301412:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797055.301414:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797055.301420:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797055.301439:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984668416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797055.301482:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.301517:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984668544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797055.301540:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.301582:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668416 00000100:00100000:1.0:1788797055.301587:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668416 00010000:00010000:1.0:1788797055.301606:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 19 pid: 22782 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.301626:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668544 00000100:00100000:1.0:1788797055.301629:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668544 00010000:00010000:1.0:1788797055.301640:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 20 pid: 22781 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.301652:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797055.301658:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:3655:x1875688984668416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797055.301669:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797055.301674:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 20 pid: 22782 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301707:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 20 pid: 22782 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301721:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797055.301750:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:3655:x1875688984668416:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797055.301756:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797055.301777:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797055.301783:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:3656:x1875688984668544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797055.301791:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797055.301795:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 19 pid: 22781 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301804:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 19 pid: 22781 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301815:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301822:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788797055.301836:0:22773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011257707s 00010000:00010000:1.0:1788797055.301840:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301847:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301854:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301860:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301866:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c5a00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797055.301870:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301888:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301898:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.301907:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797055.301936:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:3656:x1875688984668544:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797055.301942:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797055.301982:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984668544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788797055.302008:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984668416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797055.302030:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29d800/0x500835b7bd2663ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2663c3 expref: 18 pid: 22782 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.302038:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984668160:0@lo:104: 00010000:00010000:1.0:1788797055.302046:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c5600/0x500835b7bd266306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2662ff expref: 17 pid: 22781 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797055.302054:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984668288:0@lo:104: 00010000:00010000:1.0:1788797055.302066:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.302073:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.302080:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797055.302091:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd266402 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797055.304237:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:23520:x1875688984668032:12345-0@lo:253:mount.lustre.0 Request processed in 8464us (11720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.304250:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788797055.304654:0:23520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:23520:1875688984668032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797055.304668:0:23520:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788797055.304672:0:23520:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797055.304673:0:23520:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788797055.304675:0:23520:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797055.304676:0:23520:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797055.304678:0:23520:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797055.304679:0:23520:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797055.304705:0:23520:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788797055.304707:0:23520:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797055.304708:0:23520:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788797055.304721:0:23520:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1788797055.308633:0:23543:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788797055.308640:0:23543:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788797055.308705:0:23520:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788797055.312108:0:23544:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788797055.312951:0:23544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797055.315919:0:23544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788797055.316009:0:23544:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788797055.316419:0:23520:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1788797055.317260:0:23520:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788797055.317298:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788797055.317867:0:23520:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788797055.317875:0:23520:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788797055.317913:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797055.318848:0:23546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984668672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788797055.318927:0:23546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.318977:0:23546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.319085:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668672 00000100:00100000:0.0:1788797055.319093:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668672 00000100:00100000:0.0:1788797055.319149:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797055.319159:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984668672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.319243:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984668672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.319252:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788797055.319435:0:23546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984668672:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788797055.319476:0:23546:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788797055.319505:0:23546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984668800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788797055.319536:0:23546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.319564:0:23546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77180 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.319674:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668800 00000100:00100000:0.0:1788797055.319716:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668800 00000100:00100000:0.0:1788797055.319752:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797055.319759:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984668800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.319871:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984668800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.319879:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788797055.320137:0:23546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984668800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788797055.320196:0:23546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23546:1875688984668928:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788797055.320226:0:23546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797055.320241:0:23546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77240 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.320666:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984668928 00000100:00100000:0.0:1788797055.320672:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984668928 00000100:00100000:0.0:1788797055.320740:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797055.320748:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23546:x1875688984668928:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.320793:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23546:x1875688984668928:12345-0@lo:900:lod0001_rec0000.0 Request processed in 46us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.320799:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788797055.321616:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788797055.322398:0:23520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788797055.322453:0:23520:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788797055.322710:0:23520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1788797055.323176:0:23546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fb4b9ecf480 x1875688984668928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797071 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797055.323191:0:23546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23546:1875688984668928:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.323261:0:23546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984669056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.323334:0:23546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797055.323370:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669056 00000100:00100000:0.0:1788797055.323375:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669056 00000100:00100000:0.0:1788797055.323412:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797055.323421:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984669056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788797055.323509:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23546:x1875688984669056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797055.323516:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797055.323541:0:23546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb488c453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797055.323569:0:23546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23546:1875688984669056:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788797055.323612:0:23546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797055.325655:0:23546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788797055.325757:0:23546:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788797055.325762:0:23546:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:2.0:1788797055.327354:0:23520:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1788797055.330397:0:23520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788797055.334300:0:23520:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788797055.334340:0:23520:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb1ee01693988 00100000:10000000:1.0:1788797055.334349:0:23520:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788797055.336761:0:23520:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788797055.336796:0:23520:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788797055.336817:0:23520:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788797055.336840:0:23520:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788797055.348711:0:23520:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797055.350939:0:23520:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788797055.573838:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797056.166521:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797056.342525:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797056.597041:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797057.172639:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797057.172733:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788797057.172738:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb488901800 from 12 10000000:01000000:2.0:1788797057.172744:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788797057.172796:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797057.172809:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797057.172820:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797057.172861:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797057.172940:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797057.172989:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb49186d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797057.173065:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669184 00000100:00100000:0.0:1788797057.173075:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669184 00000100:00100000:0.0:1788797057.173135:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788797057.173144:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:22784:x1875688984669184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797057.173157:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797057.173170:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266409 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797057.173212:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266409 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797057.173222:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266409 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797057.173232:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd0000, rc 0) 00000100:00100000:0.0:1788797057.173294:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984669184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797057.173300:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788797057.173766:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797057.173789:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797057.173799:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797057.173868:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788797057.173906:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797057.173936:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb49186d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797057.174057:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669312 00000100:00100000:0.0:1788797057.174063:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669312 00000100:00100000:0.0:1788797057.174100:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797057.174108:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984669312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788797057.174123:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788797057.174139:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788797057.174143:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788797057.174224:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984669312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797057.174231:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788797057.174395:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797057.174465:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797057.174472:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797057.174482:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797057.174490:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788797057.174492:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb4b9fd8800 from 12 10000000:01000000:1.0:1788797057.174495:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788797057.174515:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797057.174522:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797057.174531:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797057.174545:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797057.174577:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797057.174603:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797057.174666:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669440 00000100:00100000:3.0:1788797057.174672:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669440 00000100:00100000:3.0:1788797057.174719:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788797057.174726:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984669440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797057.174734:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797057.174746:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266417 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797057.174762:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266417 expref: 19 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797057.174772:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266417 expref: 19 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797057.174780:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682e400, rc 0) 00000100:00100000:3.0:1788797057.174823:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:22784:x1875688984669440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797057.174829:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788797057.175165:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797057.175178:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797057.175187:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797057.175251:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797057.175282:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797057.175313:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797057.175430:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669568 00000100:00100000:3.0:1788797057.175437:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669568 00000100:00100000:3.0:1788797057.175460:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797057.175468:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:22784:x1875688984669568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788797057.175488:0:22782:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788797057.175502:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788797057.175505:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788797057.175600:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:22784:x1875688984669568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797057.175607:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788797057.177817:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984669568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797057.177906:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797057.177917:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797057.177927:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797057.366978:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797057.620744:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788797058.206146:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797058.645737:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788797059.222799:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797059.667865:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788797060.244466:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797060.371841:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984669696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797060.371914:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797060.371973:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669696 00000100:00100000:0.0:1788797060.371981:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669696 00000100:00100000:0.0:1788797060.372029:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797060.372038:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984669696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797060.372091:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797060.372146:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984669696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.372153:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797060.372199:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984669696:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788797060.372371:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788797060.372375:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788797060.372379:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797060.372389:0:21075:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fb38769f800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797060.372410:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a2d80 x1875688984669952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797060.372426:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797060.372430:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797060.372433:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797060.372436:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797060.372447:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797060.372449:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797060.372452:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797060.372454:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797060.372565:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984669952:0@lo:38:kworker.0 00000100:00100000:0.0:1788797060.372594:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797060.372626:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984670208:0@lo:400:kworker.0 00000100:00100000:0.0:1788797060.372652:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797060.372696:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669952 00000100:00100000:0.0:1788797060.372701:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669952 00000100:00100000:0.0:1788797060.372720:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788797060.372724:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3653:x1875688984669952:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788797060.372748:0:22792:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 776 last 0 00000020:00000080:0.0:1788797060.372783:0:22792:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd266425 00000004:00100000:0.0:1788797060.372799:0:22792:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788797060.372804:0:22792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788797060.372877:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670208 00000100:00100000:0.0:1788797060.372882:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670208 00000100:00100000:0.0:1788797060.372916:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797060.372924:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984670208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797060.372962:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984670208:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.372967:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788797060.372999:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb3881a0380 x1875688984670208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797060.373036:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984670208:0@lo:400:kworker.0 00000100:00100000:3.0:1788797060.373128:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984669824:0@lo:400:kworker.0 00000100:00100000:3.0:1788797060.373165:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797060.373210:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797060.373217:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984670080:0@lo:400:kworker.0 00000100:00100000:3.0:1788797060.373239:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797060.373267:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670080 00000100:00100000:3.0:1788797060.373271:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670080 00000100:00100000:3.0:1788797060.373294:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797060.373299:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984670080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797060.373331:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984670080:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797060.373337:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788797060.373400:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb3881a0a80 x1875688984670080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797060.373409:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984670080:0@lo:400:kworker.0 00000100:00100000:0.0:1788797060.373490:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984669824 00000100:00100000:0.0:1788797060.373494:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984669824 00000100:00100000:0.0:1788797060.373527:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788797060.373535:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3654:x1875688984669824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797060.373575:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3654:x1875688984669824:12345-0@lo:400:kworker.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.373581:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788797060.373616:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984669824:0@lo:400:kworker.0 00000100:00080000:0.0:1788797060.379349:0:22792:0:(import.c:65:import_set_state_nolock()) ffff8fb487a8a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797060.379477:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875688984669952:12345-0@lo:38:kworker.0 Request processed in 6750us (6881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.379489:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788797060.379580:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788797060.379591:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788797060.379597:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788797060.379600:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb38769f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788797060.379621:0:3653:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fb4bb8f8): req@ffff8fb3881a3480 x1875688984662400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797060.383505:0:22829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797060.383549:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797060.383970:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984662400 00000100:00100000:0.0:1788797060.383978:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984662400 00000100:00100000:3.0:1788797060.384052:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984670336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797060.384084:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797060.384178:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670336 00000100:00100000:0.0:1788797060.384182:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670336 00000100:00100000:0.0:1788797060.384196:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797060.384203:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22829:x1875688984662400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788797060.384336:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22829:x1875688984662400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 133us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.384345:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797060.384374:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788797060.384380:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984670336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797060.384403:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797060.384450:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984670336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.384457:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788797060.384513:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984670336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797060.384619:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984669952:0@lo:38:kworker.0 00000100:00100000:3.0:1788797060.394482:0:22829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22829:1875688984662400:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788797060.394535:0:22829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788797060.394592:0:22829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22829:1875688984670464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788797060.394660:0:22829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797060.394710:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498b3ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788797060.394744:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670464 00000100:00100000:3.0:1788797060.394751:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670464 00000100:00100000:3.0:1788797060.394799:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797060.394808:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22829:x1875688984670464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788797060.394957:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22829:x1875688984670464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 150us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797060.394965:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797060.395616:0:22829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22829:1875688984670464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788797060.395720:0:22829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22829:1875688984670592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788797060.395754:0:22829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797060.395777:0:22829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498b3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797060.397339:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670592 00000100:00100000:0.0:1788797060.397350:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670592 00000100:00100000:0.0:1788797060.399123:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797060.399146:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22829:x1875688984670592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788797060.399281:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22829:x1875688984670592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797060.399290:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797060.403485:0:22829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22829:1875688984670592:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788797060.403566:0:22829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797060.409042:0:22829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788797060.409121:0:22829:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:0.0:1788797060.409127:0:22829:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:2.0:1788797060.899811:0:23789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788797061.268604:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797061.656828:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788797062.278660:0:23841:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797062.278937:0:23841:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788797062.291880:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797063.323911:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788797063.553226:0:23891:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797063.553483:0:23891:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788797064.341809:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797064.467770:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797049/real 1788797049] req@ffff8fb3881a1880 x1875688984663424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797064.467815:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a1880 x1875688984663424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797064.467826:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797049/real 1788797049] req@ffff8fb3881a1180 x1875688984663552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797064 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797064.467838:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a1180 x1875688984663552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797064 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797064.467864:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797064.467903:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797064.467935:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663424:0@lo:8:kworker.0 00000100:00080000:2.0:1788797064.467941:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797064.467949:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797064.467951:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984663552:0@lo:8:kworker.0 00000100:00100000:3.0:1788797064.468241:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797064.468258:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984670720:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.468366:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797064.468435:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670720 00000100:00100000:3.0:1788797064.468446:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670720 00000100:00100000:3.0:1788797064.468508:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797064.468519:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3655:x1875688984670720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.468584:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3655:x1875688984670720:12345-0@lo:400:kworker.0 Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.468592:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797064.468647:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984670720:0@lo:400:kworker.0 00000100:00080000:3.0:1788797064.468678:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797064.468706:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797064.468709:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797064.468714:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 765 00000100:00080000:3.0:1788797064.468719:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788797064.468728:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fb49000d800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797064.468748:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984670848:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.468780:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797064.468829:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a1880 x1875688984670976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797064.468845:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797064.468848:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797064.468850:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797064.468854:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 765 00000100:00080000:3.0:1788797064.468857:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788797064.468862:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797064.468873:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3881a3480 x1875688984671104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797064.468925:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984671232:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.468957:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797064.468994:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671232 00000100:00100000:3.0:1788797064.468999:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671232 00000100:00100000:3.0:1788797064.469030:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797064.469036:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984671232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469075:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984671232:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.469081:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788797064.469109:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb3881a2d80 x1875688984671232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797064.469121:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984671232:0@lo:400:kworker.0 00000100:00080000:3.0:1788797064.469146:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797064.469156:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797064.469160:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797064.469163:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797064.469173:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469202:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797064.469233:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984670848 00000100:00100000:3.0:1788797064.469238:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984670848 00000100:00100000:3.0:1788797064.469257:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671360 00000100:00100000:3.0:1788797064.469259:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671360 00000100:00100000:3.0:1788797064.469271:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797064.469278:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984670848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469330:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984670848:12345-0@lo:400:kworker.0 Request processed in 52us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.469337:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797064.469349:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797064.469355:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984671360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469387:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984671360:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.469393:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797064.469417:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984670848:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469437:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469464:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797064.469470:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875688984671488:0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469495:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797064.469530:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671488 00000100:00100000:3.0:1788797064.469534:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671488 00000100:00100000:3.0:1788797064.469556:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788797064.469562:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875688984671488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797064.469598:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875688984671488:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797064.469604:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788797064.469630:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb3881a2d80 x1875688984671488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797064.469640:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875688984671488:0@lo:400:kworker.0 00000100:00100000:2.0:1788797064.469871:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984670976:0@lo:8:kworker.0 00000400:00000100:2.0:1788797064.469919:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984670976 offset 0 length 520: 4 00000100:00100000:2.0:1788797064.469944:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984671104:0@lo:8:kworker.0 00000400:00000100:2.0:1788797064.469964:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984671104 offset 0 length 520: 4 00000020:00000080:2.0:1788797065.073621:0:23939:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeb71bdd0 20000000:00000080:2.0:1788797065.073652:0:23939:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fb485926000 uarg=0000000000000000 20000000:01000000:2.0:1788797065.073751:0:23939:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788797065.073761:0:23939:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788797065.073767:0:23939:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788797065.075080:0:23940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788797065.075261:0:23939:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788797065.082890:0:23939:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788797065.083035:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083061:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2662ce expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083069:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083076:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083138:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083158:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 17 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.083176:0:23939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23939:1875688984671616:0@lo:104: 00000100:00100000:1.0:1788797065.083287:0:23939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797065.083372:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 17 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.083381:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 17 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.083389:0:23939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23939:1875688984671744:0@lo:104: 00000100:00100000:1.0:1788797065.083412:0:23939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797065.083637:0:23939:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb484e400c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797065.084283:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671616 00000100:00100000:0.0:1788797065.084296:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671616 00000100:00100000:0.0:1788797065.084355:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671744 00000100:00100000:0.0:1788797065.084359:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671744 00000100:00100000:0.0:1788797065.084379:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797065.084389:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:23939:x1875688984671616:12345-0@lo:104: 00010000:00010000:0.0:1788797065.084408:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.084598:0:23939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23939:1875688984671616:0@lo:104: 00010000:00010000:0.0:1788797065.084647:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788797065.084654:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:23939:x1875688984671616:12345-0@lo:104: Request processed in 267us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.084676:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797065.084721:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797065.084728:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:23939:x1875688984671744:12345-0@lo:104: 00010000:00010000:0.0:1788797065.084737:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797065.084812:0:23939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23939:1875688984671744:0@lo:104: 00010000:00010000:1.0:1788797065.084838:0:23939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085137:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797065.085147:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085157:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797065.085162:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085172:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797065.085182:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797065.085189:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788797065.085240:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085247:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788797065.085324:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984671872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797065.085374:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788797065.085488:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085496:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2663d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2663d8 expref: -99 pid: 23520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085514:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797065.085517:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085524:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797065.085527:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085534:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797065.085540:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797065.085546:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788797065.085575:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085582:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797065.085599:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085606:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1e00/0x500835b7bd2662ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2662d5 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.085638:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797065.085640:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797065.085642:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797065.085654:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984672000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797065.085704:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797065.085750:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984671872 00000100:00100000:3.0:1788797065.085757:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984671872 00010000:00010000:3.0:1788797065.085787:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 18 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.085812:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672000 00000100:00100000:3.0:1788797065.085815:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672000 00010000:00010000:3.0:1788797065.085827:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 19 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.085841:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797065.086050:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:3655:x1875688984671872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797065.086067:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797065.086074:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 19 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.086087:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 19 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.086103:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29c600/0x500835b7bd2663d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2663d1 expref: 19 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797065.086118:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797065.086244:0:22772:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788797065.086257:0:22772:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788797065.086345:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788797065.086355:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:23939:x1875688984671744:12345-0@lo:104: Request processed in 1626us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.086365:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797065.086579:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797065.086592:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3656:x1875688984672000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797065.086604:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797065.086610:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 18 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086621:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 18 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086634:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4813d0e00/0x500835b7bd2662d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2662ce expref: 18 pid: 22779 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086650:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086659:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086721:0:22772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086730:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086737:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086744:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086750:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797065.086755:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086763:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086774:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797065.086786:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797065.086835:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:3656:x1875688984672000:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797065.086842:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788797065.087004:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797065.087025:0:23939:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.087036:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797065.087042:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd26642c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797065.089541:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:3655:x1875688984671872:12345-0@lo:103:ldlm_bl.0 Request processed in 3681us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797065.089559:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788797065.089631:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984672000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797065.096129:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984671872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797065.368552:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797065.493718:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797065.493822:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797065.493986:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797055/real 1788797055] req@ffff8fb4b9ecdf80 x1875688984665728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797065.494015:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4b9ecdf80 x1875688984665728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797065.494026:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797055/real 1788797055] req@ffff8fb4b9ecca80 x1875688984665600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797065.494037:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4b9ecca80 x1875688984665600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788797065.494053:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797065.494071:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797065.494075:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665728:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788797065.494081:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bd330800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788797065.494087:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788797065.494090:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984665600:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788797065.494162:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797065.494167:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797065.494170:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797065.494173:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797065.494213:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797065.494216:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797065.494218:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb4bd330800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797065.494224:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 770 00000100:00080000:3.0:1788797065.494230:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797065.494242:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fb4bd330800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797065.494276:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb01180 x1875688984672640/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797065.494290:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797065.494293:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797065.494294:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797065.494298:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 770 00000100:00080000:3.0:1788797065.494300:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788797065.494305:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797065.494317:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb01f80 x1875688984672768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797065.494348:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984672640:0@lo:8:kworker.0 00000400:00000100:3.0:1788797065.494382:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984672640 offset 0 length 520: 4 00000100:00100000:3.0:1788797065.494410:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984672768:0@lo:8:kworker.0 00000400:00000100:3.0:1788797065.494428:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688984672768 offset 0 length 520: 4 00000100:00100000:2.0:1788797065.494481:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672128 00000100:00100000:2.0:1788797065.494491:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672128 00000100:00100000:2.0:1788797065.494560:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797065.494572:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984672128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797065.494616:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797065.494677:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984672128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.494714:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797065.494741:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984672384:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.494771:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797065.494791:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797065.494798:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984672256:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.494830:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797065.494860:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672256 00000100:00100000:2.0:1788797065.494864:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672256 00000100:00100000:3.0:1788797065.495005:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672384 00000100:00100000:3.0:1788797065.495010:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672384 00000100:00100000:3.0:1788797065.495033:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797065.495040:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797065.495094:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984672384:12345-0@lo:400:kworker.0 Request processed in 54us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797065.495101:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797065.495143:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788797065.495153:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:3655:x1875688984672256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495185:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:3655:x1875688984672256:12345-0@lo:400:kworker.0 Request processed in 35us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.495193:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788797065.495229:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984672512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495259:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797065.495296:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797065.495303:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984672896:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495326:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797065.495356:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672512 00000100:00100000:2.0:1788797065.495360:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672512 00000100:00100000:2.0:1788797065.495388:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984672896 00000100:00100000:2.0:1788797065.495390:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984672896 00000100:00100000:2.0:1788797065.495405:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797065.495411:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984672512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495445:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984672512:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.495458:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797065.495473:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797065.495479:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984672896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495507:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984672896:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797065.495513:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788797065.495570:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb00700 x1875688984672896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797065.495586:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984672896:0@lo:400:kworker.0 00010000:00080000:2.0:1788797065.495597:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb00e00 x1875688984672512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797065.495605:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984672512:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495639:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984672256:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495649:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984672384:0@lo:400:kworker.0 00000100:00100000:2.0:1788797065.495710:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797065.496867:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984673024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797065.497965:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797065.499285:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673024 00000100:00100000:3.0:1788797065.499302:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673024 00000100:00100000:1.0:1788797065.501366:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788797065.501385:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1875688984673024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797065.501439:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797065.501570:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1875688984673024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797065.501578:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788797065.501702:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984673024:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788797066.014893:0:23521:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788797066.388212:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788797066.538279:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797066.538289:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb488901800 from 13 10000000:01000000:2.0:1788797066.538296:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797066.538363:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.538376:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.538404:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.538440:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797066.538553:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797066.538612:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb49186dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797066.538648:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673152 00000100:00100000:2.0:1788797066.538657:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673152 00000100:00100000:2.0:1788797066.538755:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788797066.538766:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+16:22784:x1875688984673152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797066.538783:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797066.538801:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266433 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.538830:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266433 expref: 17 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.538844:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266433 expref: 17 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.538854:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29d200, rc 0) 00000100:00100000:2.0:1788797066.538913:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797066.538919:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788797066.554336:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797066.554381:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797066.554417:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797066.554649:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797066.554790:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797066.554851:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb49186dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797066.554880:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673280 00000100:00100000:2.0:1788797066.554890:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673280 00000100:00100000:2.0:1788797066.554960:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797066.554973:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797066.559171:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4190us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797066.559187:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797066.559436:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797066.559497:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797066.559564:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797066.559612:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb49186dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797066.559674:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673408 00000100:00100000:3.0:1788797066.559946:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673408 00000100:00100000:3.0:1788797066.560503:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788797066.560515:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797066.560667:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797066.560674:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788797066.560764:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788797066.574920:0:24001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788797066.575307:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788797066.575369:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797066.575386:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.575403:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797066.575419:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788797066.575422:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb4b9fd8800 from 13 10000000:01000000:1.0:1788797066.575426:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797066.575496:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.575508:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.575522:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.575561:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797066.575706:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797066.575780:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797066.575819:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673536 00000100:00100000:3.0:1788797066.575834:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673536 00000100:00100000:3.0:1788797066.575902:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788797066.575912:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+17:22784:x1875688984673536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797066.575931:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797066.575952:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266441 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.575984:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266441 expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.576016:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266441 expref: 18 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.576025:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682f000, rc 0) 00000100:00100000:3.0:1788797066.576314:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984673536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 402us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797066.576322:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788797066.578643:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797066.578706:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797066.578724:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797066.578896:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797066.578990:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797066.579046:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797066.579288:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673664 00000100:00100000:2.0:1788797066.579298:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673664 00000100:00100000:2.0:1788797066.579364:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788797066.579376:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984673664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797066.579573:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984673664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797066.579582:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788797066.580294:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797066.580365:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797066.580442:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797066.580556:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae773c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797066.580656:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673792 00000100:00100000:0.0:1788797066.580664:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673792 00000100:00100000:1.0:1788797066.583746:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788797066.583772:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984673792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797066.584019:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:22784:x1875688984673792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (3575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797066.584043:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788797066.584175:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984673792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788797066.584971:0:24002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788797066.585114:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788797066.585177:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788797066.585191:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797066.585207:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797067.412011:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797067.607045:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797068.445955:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797069.459857:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797070.488907:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797070.612196:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797070.612220:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984673920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797070.612296:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797070.612344:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984673920 00000100:00100000:2.0:1788797070.612351:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984673920 00000100:00100000:2.0:1788797070.612395:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797070.612404:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984673920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797070.612436:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788797070.612479:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984673920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.612486:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788797070.612526:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984673920:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788797070.617031:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797070.617037:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797070.617040:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797070.617043:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797070.617061:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797070.617065:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788797070.617067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788797070.617070:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788797070.617115:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984674048:0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617196:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797070.617239:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797070.617245:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984674176:0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617271:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797070.617313:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674048 00000100:00100000:2.0:1788797070.617321:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674048 00000100:00100000:2.0:1788797070.617364:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797070.617373:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3656:x1875688984674048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617423:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:3656:x1875688984674048:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.617430:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788797070.617463:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674176 00000100:00100000:2.0:1788797070.617467:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674176 00000100:00100000:2.0:1788797070.617488:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797070.617495:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984674176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617527:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984674176:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.617533:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797070.617551:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984674304:0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617576:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797070.617595:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788797070.617601:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984674432:0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617621:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797070.617643:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674304 00000100:00100000:2.0:1788797070.617647:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674304 00000100:00100000:2.0:1788797070.617673:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674432 00000100:00100000:2.0:1788797070.617677:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674432 00000100:00100000:2.0:1788797070.617716:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797070.617723:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984674304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617896:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984674304:12345-0@lo:400:kworker.0 Request processed in 173us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.617911:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797070.617925:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797070.617931:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984674432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.617961:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984674432:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797070.617967:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797070.618008:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984674176:0@lo:400:kworker.0 00000100:00100000:2.0:1788797070.618018:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984674048:0@lo:400:kworker.0 00010000:00080000:2.0:1788797070.618047:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb387b90e00 x1875688984674432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797070.618057:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984674432:0@lo:400:kworker.0 00010000:00080000:2.0:1788797070.618066:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb387b92a00 x1875688984674304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797070.618074:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984674304:0@lo:400:kworker.0 00000100:00100000:1.0:1788797070.618232:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797070.618242:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984674560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797070.618273:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797070.618298:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674560 00000100:00100000:1.0:1788797070.618303:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674560 00000100:00100000:1.0:1788797070.618322:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797070.618328:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984674560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797070.618353:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797070.618385:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984674560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797070.618390:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797070.618428:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984674560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788797071.511044:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797071.892396:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797072.532276:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788797072.850043:0:24288:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788797072.850048:0:24288:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788797072.850049:0:24288:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788797072.850256:0:24288:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fb4a008a800 00000020:01000004:1.0:1788797072.850274:0:24288:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788797072.850289:0:24288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788797072.850303:0:24288:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fb498b28000) 00000020:00000080:1.0:1788797072.850321:0:24288:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788797072.978894:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788797072.982317:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797072.985266:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797072.985911:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797072.986356:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788797072.986559:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788797072.986917:0:24288:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788797072.990610:0:24288:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788797072.993334:0:24288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788797072.993351:0:24288:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788797072.993364:0:24288:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x500835b7bd266456 00000020:01000004:0.0:1788797072.993373:0:24288:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788797072.993398:0:24288:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788797072.993402:0:24288:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788797072.993408:0:24288:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788797072.993413:0:24288:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788797072.993428:0:24288:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fb4889e4d28) 00000020:00000080:0.0:1788797072.993440:0:24288:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788797072.998871:0:24288:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797072.999103:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788797072.999109:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788797073.009746:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788797073.009758:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788797073.012652:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788797073.012665:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788797073.019265:0:24288:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788797073.019462:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788797073.019469:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788797073.026938:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788797073.026958:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788797073.081751:0:24288:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797073.085587:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788797073.085594:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788797073.086935:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788797073.086945:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788797073.094906:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788797073.101257:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788797073.116372:0:24288:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788797073.116595:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788797073.116602:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788797073.121297:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788797073.121311:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788797073.169530:0:24288:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788797073.169941:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788797073.169955:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788797073.171102:0:24288:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788797073.171112:0:24288:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788797073.171673:0:24288:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788797073.171731:0:24288:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788797073.171739:0:24288:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788797073.186115:0:24288:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788797073.186291:0:24288:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.127@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788797073.186296:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788797073.186298:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797073.186299:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797073.186301:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797073.186302:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797073.186304:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797073.186305:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797073.186307:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797073.186308:0:24288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797073.186312:0:24288:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788797073.186314:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788797073.186316:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797073.186317:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797073.186318:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797073.186319:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797073.186320:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797073.186322:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797073.186323:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797073.186324:0:24288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788797073.186362:0:24288:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788797073.186383:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788797073.186586:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.186735:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775300 going to sleep for 11 seconds 00000100:00100000:1.0:1788797073.187357:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674688 00000100:00100000:1.0:1788797073.187367:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674688 00000100:00100000:1.0:1788797073.187425:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788797073.187435:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:24288:x1875688984674688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797073.187476:0:22779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788797073.187480:0:22779:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788797073.187484:0:22779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788797073.188393:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:24288:x1875688984674688:12345-0@lo:253:mount.lustre.0 Request processed in 957us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.188404:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788797073.188481:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674688:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788797073.188493:0:24288:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788797073.188495:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788797073.188497:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788797073.188499:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788797073.188500:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788797073.188501:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788797073.188510:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788797073.188511:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788797073.188513:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788797073.188514:0:24288:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788797073.188533:0:24288:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fb4a008a800 from lustre-OST0000 10000000:01000000:3.0:1788797073.188558:0:24288:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788797073.188560:0:24288:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788797073.188568:0:24288:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fb3875b3370 local copy 00010000:00010000:3.0:1788797073.188577:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797073.188669:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797073.188763:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.188948:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788797073.189039:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674816 00000100:00100000:2.0:1788797073.189045:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674816 00000100:00100000:2.0:1788797073.189122:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788797073.189143:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:24288:x1875688984674816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797073.189252:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:24288:x1875688984674816:12345-0@lo:501:mount.lustre.0 Request processed in 110us (488us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797073.189259:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788797073.189403:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788797073.189418:0:24288:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788797073.189435:0:24288:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788797073.189442:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.189452:0:24288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797073.189477:0:24288:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fb4a008a800 10000000:01000000:3.0:1788797073.189481:0:24288:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788797073.189486:0:24288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788797073.189488:0:24288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788797073.189492:0:24288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788797073.189495:0:24288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788797073.189513:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.189529:0:24288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.189539:0:24288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797073.189551:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797073.189574:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.189642:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.189668:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984674944 00000100:00100000:0.0:1788797073.189672:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984674944 00000100:00100000:0.0:1788797073.189718:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788797073.189724:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+18:24288:x1875688984674944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797073.189733:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797073.189744:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb491dd0e00/0x500835b7bd26646b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266464 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.189780:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb491dd0e00/0x500835b7bd26646b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266464 expref: 19 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.189790:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb491dd0e00/0x500835b7bd26646b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266464 expref: 19 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.189799:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd0e00, rc 0) 00000100:00100000:0.0:1788797073.189827:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984674944:12345-0@lo:101:mount.lustre.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.189834:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797073.190104:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984674944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797073.190116:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26646b expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.190125:0:24288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26646b expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797073.191337:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788797073.192058:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797073.197057:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788797073.197111:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788797073.197124:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788797073.197286:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788797073.197306:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788797073.197321:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788797073.197333:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788797073.197348:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788797073.197361:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788797073.197372:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788797073.197410:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788797073.197422:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788797073.197447:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788797073.197452:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788797073.197576:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797073.197642:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.197788:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3867759c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.198036:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675072 00000100:00100000:0.0:1788797073.198044:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675072 00000100:00100000:0.0:1788797073.198146:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797073.198158:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797073.198458:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675072:12345-0@lo:501:mount.lustre.0 Request processed in 302us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.198466:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788797073.198546:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797073.198587:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797073.198634:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.198851:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3867759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797073.199104:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675200 00000100:00100000:1.0:1788797073.199111:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675200 00000100:00100000:1.0:1788797073.199154:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788797073.199162:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797073.200306:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675200:12345-0@lo:503:mount.lustre.0 Request processed in 1141us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.200316:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788797073.200418:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797073.201100:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797073.201396:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.201450:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.201493:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.201554:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675328 00000100:00100000:0.0:1788797073.201562:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675328 00000100:00100000:0.0:1788797073.201600:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788797073.201609:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.202422:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675328:12345-0@lo:502:mount.lustre.0 Request processed in 811us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.202432:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788797073.202610:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797073.203079:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788797073.203108:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788797073.203123:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788797073.203276:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788797073.203296:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788797073.203307:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788797073.203319:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788797073.203330:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788797073.203343:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788797073.203357:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788797073.203382:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788797073.203397:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788797073.203441:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.203489:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.203582:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797073.203626:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675456 00000100:00100000:1.0:1788797073.203639:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675456 00000100:00100000:1.0:1788797073.204005:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788797073.204015:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797073.204302:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675456:12345-0@lo:502:mount.lustre.0 Request processed in 288us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797073.204310:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788797073.204420:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797073.204487:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788797073.204498:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788797073.209831:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788797073.209843:0:24305:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788797073.209849:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797073.209852:0:24305:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788797073.209866:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788797073.209883:0:24305:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fb3875b0000) 00000020:00000080:3.0:1788797073.209909:0:24305:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788797073.209915:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788797073.210837:0:24305:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4a008a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788797073.210850:0:24305:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788797073.211037:0:24305:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x500835b7bd266479 00010000:00010000:2.0:1788797073.223568:0:24305:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788797073.225356:0:24305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788797073.235923:0:24305:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788797073.239339:0:24305:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788797073.239355:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.239375:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239378:0:24305:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788797073.239382:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788797073.239385:0:24305:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788797073.239386:0:24305:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797073.239388:0:24305:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788797073.239390:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788797073.239394:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239395:0:24305:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788797073.239398:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.239401:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239402:0:24305:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788797073.239405:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788797073.239408:0:24305:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788797073.239411:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.239413:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239414:0:24305:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788797073.239422:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.239425:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239427:0:24305:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788797073.239431:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788797073.239464:0:24305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.239468:0:24305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.239469:0:24305:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788797073.239473:0:24305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788797073.239741:0:24288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788797073.239793:0:24288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788797073.239815:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26646b expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.239829:0:24288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb38682f800/0x500835b7bd266464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26646b expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797073.239837:0:24288:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb4a008a800 from 1 10000000:01000000:3.0:1788797073.239840:0:24288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788797073.239876:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.239891:0:24288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.239903:0:24288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797073.239930:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788797073.240024:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.240920:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797073.241882:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675584 00000100:00100000:2.0:1788797073.241893:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675584 00000100:00100000:2.0:1788797073.241947:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788797073.241957:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:24288:x1875688984675584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797073.241988:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797073.242007:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266480 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.242038:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266480 expref: 20 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.242470:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266480 expref: 20 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.242481:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29d800, rc 0) 00000100:00100000:2.0:1788797073.242562:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675584:12345-0@lo:101:mount.lustre.0 Request processed in 607us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.242571:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788797073.242915:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797073.242936:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.242948:0:24288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797073.248878:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788797073.249297:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797073.249516:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788797073.249541:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788797073.249556:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788797073.249569:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788797073.249581:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788797073.249596:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788797073.249609:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788797073.249622:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788797073.249654:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788797073.249669:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788797073.249734:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788797073.249753:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788797073.249769:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788797073.249849:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797073.249923:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.249972:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3867759c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.251869:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675712 00000100:00100000:0.0:1788797073.251884:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675712 00000100:00100000:0.0:1788797073.251948:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788797073.251958:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797073.252115:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675712:12345-0@lo:501:mount.lustre.0 Request processed in 158us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.252122:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788797073.253262:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797073.253319:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797073.253376:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.253417:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3867759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797073.253522:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675840 00000100:00100000:2.0:1788797073.253528:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675840 00000100:00100000:2.0:1788797073.253576:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788797073.253585:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797073.253741:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675840:12345-0@lo:503:mount.lustre.0 Request processed in 158us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.253749:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788797073.253982:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788797073.254558:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788797073.255909:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.255984:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.256081:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386775cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797073.257610:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984675968 00000100:00100000:2.0:1788797073.257897:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984675968 00000100:00100000:2.0:1788797073.257989:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788797073.258001:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797073.258201:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984675968:12345-0@lo:502:mount.lustre.0 Request processed in 202us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.258209:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788797073.258290:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984675968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797073.258559:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788797073.258591:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788797073.258606:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788797073.258621:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788797073.258649:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788797073.258663:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788797073.258676:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788797073.258725:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788797073.259209:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788797073.259233:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788797073.259248:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788797073.259291:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.259349:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.259777:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.259886:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676096 00000100:00100000:3.0:1788797073.259894:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676096 00000100:00100000:3.0:1788797073.259934:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788797073.259943:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984676096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.260076:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984676096:12345-0@lo:502:mount.lustre.0 Request processed in 134us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.260084:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788797073.260185:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797073.260239:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788797073.260249:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788797073.261335:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.261348:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261350:0:24309:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788797073.261357:0:24309:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb4a008a800 00000020:00000080:2.0:1788797073.261360:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797073.261368:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.261370:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261372:0:24309:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788797073.261374:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.261377:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261378:0:24309:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788797073.261381:0:24309:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb4a008a800 00000020:00000080:2.0:1788797073.261384:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797073.261444:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.261448:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261449:0:24309:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788797073.261451:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.261454:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261455:0:24309:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797073.261458:0:24309:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb4a008a800 00000020:00000080:2.0:1788797073.261467:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797073.261488:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.261490:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261491:0:24309:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788797073.261493:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788797073.261496:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261497:0:24309:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788797073.261500:0:24309:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb4a008a800 00000020:00000080:2.0:1788797073.261502:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788797073.261523:0:24309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788797073.261526:0:24309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788797073.261527:0:24309:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788797073.261530:0:24309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788797073.263265:0:24288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788797073.263308:0:24288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797073.263330:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.263355:0:24288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797073.263424:0:24288:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788797073.263428:0:24288:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fb4a008a800 10000000:01000000:0.0:1788797073.263431:0:24288:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fb4a008a800 10000000:01000000:0.0:1788797073.263435:0:24288:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788797073.263441:0:24288:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fb4a008a800 from 1 10000000:01000000:0.0:1788797073.263444:0:24288:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788797073.263479:0:24288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.263487:0:24288:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.263498:0:24288:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797073.263522:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788797073.263585:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.263643:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.263900:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676224 00000100:00100000:3.0:1788797073.263909:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676224 00000100:00100000:3.0:1788797073.263960:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788797073.263970:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:24288:x1875688984676224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797073.263992:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797073.264005:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682f200/0x500835b7bd266495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26648e expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.264032:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682f200/0x500835b7bd266495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26648e expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.264055:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682f200/0x500835b7bd266495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26648e expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.264063:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682f200, rc 0) 00000100:00100000:3.0:1788797073.264107:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676224:12345-0@lo:101:mount.lustre.0 Request processed in 139us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.264113:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788797073.264341:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797073.264358:0:24288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266495 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.264367:0:24288:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266495 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797073.274549:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788797073.275275:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797073.275483:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788797073.275511:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788797073.275527:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788797073.275542:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788797073.275555:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788797073.275581:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788797073.275595:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788797073.275608:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788797073.275634:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788797073.275650:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788797073.275663:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788797073.275675:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788797073.275725:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788797073.275740:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788797073.275752:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788797073.276740:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788797073.277929:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788797073.277966:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788797073.277980:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788797073.277993:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788797073.278007:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788797073.278039:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788797073.278118:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788797073.278147:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788797073.278174:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788797073.278190:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788797073.278205:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788797073.278217:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788797073.278230:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788797073.278256:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788797073.278269:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788797073.278281:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788797073.278293:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788797073.278306:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788797073.278321:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788797073.278332:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788797073.278345:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788797073.278374:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788797073.278391:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788797073.278404:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788797073.278419:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788797073.278449:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788797073.278463:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788797073.278479:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788797073.278493:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788797073.278505:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788797073.278520:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788797073.278535:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788797073.281303:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788797073.281366:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788797073.281394:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788797073.281401:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788797073.281521:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797073.281591:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.281959:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676352 00000100:00100000:3.0:1788797073.281968:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676352 00000100:00100000:3.0:1788797073.282026:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788797073.282036:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797073.282963:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.283302:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676352:12345-0@lo:501:mount.lustre.0 Request processed in 1266us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.283313:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788797073.284253:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797073.284315:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797073.284373:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.287443:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797073.296750:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676480 00000100:00100000:2.0:1788797073.296781:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676480 00000100:00100000:2.0:1788797073.296852:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788797073.296864:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788797073.297034:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676480:12345-0@lo:503:mount.lustre.0 Request processed in 172us (12660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.297042:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788797073.301365:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788797073.303363:0:24288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788797073.303475:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.303551:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.303805:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd626300 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.305358:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676608 00000100:00100000:3.0:1788797073.305373:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676608 00000100:00100000:3.0:1788797073.305434:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788797073.305445:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.305610:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676608:12345-0@lo:502:mount.lustre.0 Request processed in 167us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.305627:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788797073.305829:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797073.306076:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788797073.306108:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788797073.306122:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788797073.306151:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788797073.306177:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788797073.306189:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788797073.306200:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788797073.306212:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788797073.306224:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788797073.306236:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788797073.306249:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788797073.306263:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788797073.306275:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788797073.306289:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788797073.306301:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788797073.306333:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788797073.306347:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788797073.306358:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788797073.306370:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788797073.306383:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788797073.306397:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788797073.306409:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788797073.306423:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788797073.306437:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788797073.306458:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788797073.306471:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788797073.306483:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788797073.306495:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788797073.306507:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788797073.306519:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788797073.306530:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788797073.306555:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788797073.306569:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788797073.306581:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788797073.306595:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788797073.306607:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788797073.306904:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788797073.306930:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788797073.306943:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788797073.306954:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788797073.306967:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788797073.306980:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788797073.306993:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788797073.307005:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788797073.307019:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788797073.307033:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788797073.307046:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788797073.307073:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788797073.307135:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.307411:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.307462:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd626300 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.307588:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676736 00000100:00100000:3.0:1788797073.307595:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676736 00000100:00100000:0.0:1788797073.307882:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788797073.307894:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.308012:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676736:12345-0@lo:502:mount.lustre.0 Request processed in 120us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.308025:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788797073.309725:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797073.310445:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788797073.310475:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788797073.310513:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797073.310583:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.311188:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676864 00000100:00100000:3.0:1788797073.311197:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676864 00000100:00100000:3.0:1788797073.311244:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788797073.311252:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797073.311368:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984676864:12345-0@lo:502:mount.lustre.0 Request processed in 116us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.311376:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788797073.312962:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.313003:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984676864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797073.313936:0:24288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788797073.313957:0:24288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788797073.318371:0:24314:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788797073.318391:0:24314:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fb4bab68000) 00000020:00000080:3.0:1788797073.318417:0:24314:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788797073.318493:0:24314:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4a008a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797073.318497:0:24314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb4a008a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797073.318499:0:24314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb4a008a800 3 00010000:00080000:3.0:1788797073.318526:0:24314:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb3869d7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1788797073.325521:0:24314:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788797073.327556:0:24314:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788797073.327607:0:24314:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788797073.327623:0:24314:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x500835b7bd2664a3 00000100:00080000:3.0:1788797073.327634:0:24314:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797073.327646:0:24314:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fb3869d7800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797073.327712:0:24314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb03480 x1875688984676992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797073.327739:0:24314:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788797073.327789:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.327800:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.327803:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.327806:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.327833:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.327836:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.327838:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.327841:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788797073.327877:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.327939:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.327977:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797073.327983:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984677504:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.328007:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.328060:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.328084:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.328102:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797073.328107:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984677376:0@lo:400:kworker.0 00000100:00100000:2.0:1788797073.329253:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984676992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788797073.329308:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797073.329388:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677504 00000100:00100000:2.0:1788797073.329396:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677504 00000100:00100000:2.0:1788797073.329437:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677248 00000100:00100000:2.0:1788797073.329439:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677248 00000100:00100000:2.0:1788797073.329451:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984676992 00000100:00100000:2.0:1788797073.329453:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984676992 00000100:00100000:2.0:1788797073.329467:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797073.329476:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984677504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797073.329546:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984677504:12345-0@lo:400:kworker.0 Request processed in 71us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.329553:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797073.329570:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797073.329577:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984677248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797073.329604:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984677248:12345-0@lo:400:kworker.0 Request processed in 29us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.329610:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797073.329635:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797073.329639:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3653:x1875688984676992:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797073.329661:0:22789:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 789 last 0 00000020:00000080:2.0:1788797073.329714:0:22789:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x500835b7bd2664aa 00000004:00100000:2.0:1788797073.329731:0:22789:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788797073.329972:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788797073.330021:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb03100 x1875688984677248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797073.330035:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984677248:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.330090:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677120 00000100:00100000:3.0:1788797073.330095:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677120 00000100:00100000:3.0:1788797073.330114:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677376 00000100:00100000:3.0:1788797073.330138:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677376 00000100:00100000:3.0:1788797073.330158:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797073.330164:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984677120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.330201:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984677120:12345-0@lo:400:kworker.0 Request processed in 38us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.330207:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797073.330219:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788797073.330225:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984677376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.330255:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984677376:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.330260:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788797073.330297:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb00a80 x1875688984677504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797073.330309:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984677504:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.330320:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788797073.330339:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984677376:0@lo:400:kworker.0 00000100:00080000:2.0:1788797073.330936:0:22789:0:(import.c:65:import_set_state_nolock()) ffff8fb484294000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797073.330997:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875688984676992:12345-0@lo:38:llog_process_th.0 Request processed in 1355us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797073.331006:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788797073.331183:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb03480 x1875688984676992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797073.331191:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797073.331198:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788797073.331206:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788797073.331211:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788797073.331214:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3869d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788797073.331219:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3653:1875688984676992:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788797073.331332:0:24314:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788797073.331352:0:24314:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8fb4bab6b370) 00000020:00000080:3.0:1788797073.331381:0:24314:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788797073.331456:0:24314:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb4a008a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797073.331461:0:24314:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb4a008a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788797073.331463:0:24314:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb4a008a800 3 00010000:00080000:3.0:1788797073.331491:0:24314:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb4bab2b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1788797073.334265:0:24314:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788797073.334489:0:24314:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788797073.334534:0:24314:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788797073.334547:0:24314:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x500835b7bd2664b8 00000100:00080000:3.0:1788797073.334557:0:24314:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797073.334567:0:24314:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8fb4bab2b000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797073.334603:0:24314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb03480 x1875688984677632/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797073.336294:0:24314:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788797073.336324:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.336330:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.336332:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.336335:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.336340:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.336343:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797073.336345:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797073.336348:0:21075:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788797073.336870:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3653:1875688984677632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797073.336943:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.337208:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677632 00000100:00100000:3.0:1788797073.337217:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677632 00000100:00100000:3.0:1788797073.337436:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788797073.337445:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1875688984677632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788797073.337474:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 789 last 0 00000020:00000080:3.0:1788797073.337535:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x500835b7bd2664bf 00000004:00100000:3.0:1788797073.337550:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788797073.337584:0:22788:0:(import.c:65:import_set_state_nolock()) ffff8fb488905800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797073.337654:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875688984677632:12345-0@lo:38:llog_process_th.0 Request processed in 209us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.337662:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1788797073.338955:0:24314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:2.0:1788797073.340802:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fb4bfb03480 x1875688984677632/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797073.340817:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788797073.340827:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788797073.340835:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788797073.340841:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788797073.340845:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bab2b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788797073.340859:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3653:1875688984677632:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788797073.341017:0:24288:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788797073.341204:0:24288:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788797073.341228:0:24288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266495 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.341240:0:24288:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0600/0x500835b7bd26648e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266495 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788797073.341291:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788797073.341293:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797073.341295:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797073.341296:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797073.341297:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797073.341299:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797073.341300:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797073.341302:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797073.341307:0:24288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797073.341310:0:24288:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788797073.341313:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797073.341314:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797073.341315:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797073.341316:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797073.341317:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797073.341318:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797073.341319:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797073.341320:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797073.341322:0:24288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797073.341346:0:24288:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788797073.341363:0:24288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984677760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797073.341427:0:24288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797073.341472:0:24288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd626300 going to sleep for 11 seconds 00000100:00100000:3.0:1788797073.342365:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677760 00000100:00100000:3.0:1788797073.342376:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677760 00000100:00100000:3.0:1788797073.342905:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788797073.342918:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984677760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788797073.342950:0:22779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788797073.342964:0:22779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788797073.358749:0:22779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788797073.358775:0:22779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788797073.359186:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:24288:x1875688984677760:12345-0@lo:253:mount.lustre.0 Request processed in 16267us (17754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.359200:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788797073.359642:0:24288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:24288:1875688984677760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788797073.359657:0:24288:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788797073.359660:0:24288:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788797073.359662:0:24288:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788797073.359663:0:24288:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797073.359664:0:24288:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797073.359666:0:24288:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797073.359667:0:24288:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797073.359668:0:24288:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797073.359670:0:24288:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797073.359671:0:24288:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788797073.359701:0:24288:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788797073.360438:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788797073.360445:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788797073.360466:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360483:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266409 expref: 20 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360491:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266417 expref: 20 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360498:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360533:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 20 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360546:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 20 pid: 22782 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797073.360559:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984677888:0@lo:104: 00000100:00100000:1.0:1788797073.360608:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797073.360671:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 20 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.360713:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 20 pid: 22779 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797073.360721:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984678016:0@lo:104: 00000100:00100000:1.0:1788797073.360748:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797073.360779:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4baca8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788797073.361263:0:22770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788797073.361282:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984677888 00000100:00100000:0.0:1788797073.361290:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984677888 00000100:00100000:0.0:1788797073.361324:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678016 00000100:00100000:0.0:1788797073.361327:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678016 00000100:00100000:0.0:1788797073.361341:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797073.361349:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984677888:12345-0@lo:104: 00010000:00010000:0.0:1788797073.361362:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.361429:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788797073.361434:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984677888:12345-0@lo:104: Request processed in 87us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.361441:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797073.361458:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797073.361464:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4a2366850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984678016:12345-0@lo:104: 00010000:00010000:0.0:1788797073.361472:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.361498:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788797073.361503:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4a2366850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984678016:12345-0@lo:104: Request processed in 40us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.361507:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797073.361550:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984677888:0@lo:104: 00000100:00100000:0.0:1788797073.361557:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984678016:0@lo:104: 00010000:00010000:0.0:1788797073.361577:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361630:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797073.361638:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361645:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c5a00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797073.361650:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361666:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797073.361675:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797073.361861:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797073.361897:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361904:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797073.361925:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361933:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c5a00/0x500835b7bd266417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26641e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361943:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797073.361946:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361951:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29d600 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797073.361954:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361960:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797073.361965:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797073.361976:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797073.361989:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.361994:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797073.362010:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.362016:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d600/0x500835b7bd266409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266410 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.362029:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797073.362031:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797073.362033:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797073.362292:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984678144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797073.362336:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.362381:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984678272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797073.362410:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797073.362445:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678144 00000100:00100000:3.0:1788797073.362449:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678144 00010000:00010000:3.0:1788797073.362473:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 21 pid: 22782 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797073.362494:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678272 00000100:00100000:3.0:1788797073.362496:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678272 00010000:00010000:3.0:1788797073.362507:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 22 pid: 22779 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797073.362535:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797073.362550:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:3657:x1875688984678144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797073.362562:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797073.362568:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 22 pid: 22782 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.362578:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 22 pid: 22782 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.362593:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682e400/0x500835b7bd26641e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd266417 expref: 22 pid: 22782 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797073.362604:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797073.362808:0:23941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797073.362817:0:23941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3654:x1875688984678272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797073.362826:0:23941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797073.362831:0:23941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 21 pid: 22779 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362840:0:23941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 21 pid: 22779 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362862:0:23941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd0000/0x500835b7bd266410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd266409 expref: 21 pid: 22779 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362874:0:23941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362882:0:23941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788797073.362895:0:23941:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011257707s 00010000:00010000:0.0:1788797073.362899:0:23941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362906:0:23941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362912:0:23941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362919:0:23941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362925:0:23941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797073.362929:0:23941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362936:0:23941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362959:0:23941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797073.362974:0:23941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797073.363007:0:23941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387781450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:3654:x1875688984678272:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797073.363014:0:23941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788797073.363231:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.363239:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797073.363246:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd2664c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797073.363581:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797073.363722:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:3657:x1875688984678144:12345-0@lo:103:ldlm_bl.0 Request processed in 1171us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797073.363731:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788797073.363807:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984678272:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788797073.365594:0:24288:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788797073.368650:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984678144:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788797073.369072:0:24288:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788797073.369079:0:24288:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788797073.369113:0:24288:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788797073.369264:0:24288:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788797073.369282:0:24288:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788797073.369300:0:24288:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788797073.375027:0:24288:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797073.375440:0:24288:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797073.556454:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788797074.361591:0:24367:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797074.362276:0:24367:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797074.582901:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788797074.835917:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788797074.835925:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb488901800 from 13 10000000:01000000:0.0:1788797074.835940:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797074.835982:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797074.835994:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797074.836005:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797074.836030:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797074.836115:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797074.836155:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b0ec4240 going to sleep for 11 seconds 00000100:00100000:3.0:1788797074.836314:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678400 00000100:00100000:3.0:1788797074.836323:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678400 00000100:00100000:3.0:1788797074.836378:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788797074.836389:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+19:22784:x1875688984678400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797074.836403:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797074.836416:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2664cd expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.836439:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2664cd expref: 20 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.836462:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2664cd expref: 20 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.836471:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682e400, rc 0) 00000100:00100000:3.0:1788797074.836523:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:22784:x1875688984678400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797074.836530:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788797074.836605:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797074.836620:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.836630:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797074.836705:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797074.836739:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797074.836756:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386715c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788797074.836868:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678528 00000100:00100000:0.0:1788797074.836873:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678528 00000100:00100000:0.0:1788797074.836915:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788797074.836921:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:22784:x1875688984678528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788797074.836943:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788797074.836959:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788797074.836962:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788797074.837034:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:22784:x1875688984678528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797074.837041:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788797074.837165:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797074.837236:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797074.837243:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.837251:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797074.837259:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788797074.837261:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb4b9fd8800 from 13 10000000:01000000:1.0:1788797074.837264:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788797074.837281:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.837288:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.837296:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797074.837309:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797074.837334:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797074.837363:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386715c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797074.837413:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678656 00000100:00100000:3.0:1788797074.837417:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678656 00000100:00100000:3.0:1788797074.837447:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788797074.837454:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:22784:x1875688984678656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797074.837461:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797074.837471:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2664db expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.837486:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2664db expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.837495:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2664db expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797074.837501:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682ea00, rc 0) 00000100:00100000:3.0:1788797074.837527:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984678656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797074.837534:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788797074.837596:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797074.837606:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.837613:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797074.837656:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797074.837706:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797074.837721:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb386715c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797074.837768:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678784 00000100:00100000:3.0:1788797074.837844:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678784 00000100:00100000:3.0:1788797074.837880:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788797074.837886:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984678784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788797074.837897:0:22779:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788797074.837909:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788797074.837912:0:22779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788797074.837991:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984678784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797074.837997:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788797074.838117:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ece680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984678784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797074.838160:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797074.838166:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797074.838173:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797075.608489:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797075.736446:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984678912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797075.736521:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797075.737748:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984678912 00000100:00100000:0.0:1788797075.737761:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984678912 00000100:00100000:0.0:1788797075.737816:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797075.737826:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984678912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797075.737857:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797075.737918:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984678912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797075.737925:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788797075.737983:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984678912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797075.739295:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797075.739312:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984679040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797075.739362:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797075.739450:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679040 00000100:00100000:1.0:1788797075.739457:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679040 00000100:00100000:1.0:1788797075.739492:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797075.739500:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984679040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797075.739522:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797075.739555:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984679040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797075.739562:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797075.740245:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984679040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788797076.633239:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797077.658787:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797077.849554:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797078.684072:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797078.807854:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797078.807881:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797078.807884:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797078.807887:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797078.807920:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797078.807923:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788797078.807926:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797078.807930:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788797078.807988:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984679552:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.808100:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797078.808257:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984679168:0@lo:400:kworker.0 00000100:00100000:3.0:1788797078.808299:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797078.808333:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984679680:0@lo:400:kworker.0 00000100:00100000:3.0:1788797078.808375:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797078.808415:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679168 00000100:00100000:3.0:1788797078.808424:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679168 00000100:00100000:3.0:1788797078.808483:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788797078.808493:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3657:x1875688984679168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797078.808551:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3657:x1875688984679168:12345-0@lo:400:kworker.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797078.808559:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788797078.808602:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679680 00000100:00100000:3.0:1788797078.808606:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679680 00000100:00100000:3.0:1788797078.808634:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797078.808641:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984679680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797078.808673:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984679680:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797078.808700:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797078.808747:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984679168:0@lo:400:kworker.0 00010000:00080000:3.0:1788797078.808764:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecf100 x1875688984679680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797078.808778:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984679680:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.808962:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984679296:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.808994:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797078.809012:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984679808:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.809061:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797078.809079:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788797078.809087:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984679424:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.809114:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797078.809130:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984679936:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.809307:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797078.809341:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679552 00000100:00100000:1.0:1788797078.809411:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679552 00000100:00100000:1.0:1788797078.809440:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679296 00000100:00100000:1.0:1788797078.809443:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679296 00000100:00100000:1.0:1788797078.809458:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797078.809756:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984679552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.809826:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984679552:12345-0@lo:400:kworker.0 Request processed in 361us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.809833:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788797078.809850:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797078.809855:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984679296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.809881:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984679296:12345-0@lo:400:kworker.0 Request processed in 27us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.809886:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797078.809907:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679808 00000100:00100000:1.0:1788797078.809910:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679808 00000100:00100000:1.0:1788797078.809947:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679424 00000100:00100000:1.0:1788797078.809949:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679424 00000100:00100000:1.0:1788797078.809957:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984679936 00000100:00100000:1.0:1788797078.809959:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984679936 00000100:00100000:1.0:1788797078.809972:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797078.809977:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875688984679808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.810001:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875688984679808:12345-0@lo:400:kworker.0 Request processed in 25us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.810006:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788797078.810016:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797078.810021:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984679424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.810055:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984679424:12345-0@lo:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.810061:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797078.810070:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797078.810074:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984679936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.810106:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984679936:12345-0@lo:400:kworker.0 Request processed in 31us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797078.810113:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788797078.810873:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788797078.810880:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788797078.811724:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984679552:0@lo:400:kworker.0 00010000:00080000:1.0:1788797078.811799:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9eced80 x1875688984679424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797078.811811:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984679424:0@lo:400:kworker.0 00010000:00080000:1.0:1788797078.811824:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecf480 x1875688984679936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797078.811833:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984679936:0@lo:400:kworker.0 00000100:00100000:1.0:1788797078.811845:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984679296:0@lo:400:kworker.0 00010000:00080000:1.0:1788797078.811855:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecf800 x1875688984679808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797078.811863:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3654:1875688984679808:0@lo:400:kworker.0 00010000:00010000:0.0:1788797079.701624:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797080.534316:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797065/real 1788797065] req@ffff8fb4bfb01180 x1875688984672640/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797080.534365:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4bfb01180 x1875688984672640/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797080.534377:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797065/real 1788797065] req@ffff8fb4bfb01f80 x1875688984672768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797080 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797080.534388:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb4bfb01f80 x1875688984672768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797080 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797080.534414:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bd330800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797080.534435:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797080.534440:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984672640:0@lo:8:kworker.0 00000100:00080000:2.0:1788797080.534445:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797080.534451:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797080.534454:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984672768:0@lo:8:kworker.0 00000100:00080000:3.0:1788797080.536930:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797080.536939:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797080.536943:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797080.536946:0:505:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788797080.536972:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797080.536975:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788797080.536979:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb4bd330800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797080.536988:0:505:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 781 00000100:00080000:3.0:1788797080.536996:0:505:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788797080.537021:0:505:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fb4bd330800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797080.537048:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb01500 x1875688984680576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797080.537064:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797080.537067:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797080.537069:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797080.537084:0:505:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 781 00000100:00080000:3.0:1788797080.537086:0:505:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788797080.537091:0:505:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797080.537101:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb02a00 x1875688984680704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797080.537177:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984680192:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537261:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537302:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984680960:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537327:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537351:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788797080.537355:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984680064:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537386:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537422:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984680832:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537445:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537502:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680192 00000100:00100000:3.0:1788797080.537514:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680192 00000100:00100000:3.0:1788797080.537574:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797080.537585:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984680192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537652:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984680192:12345-0@lo:400:kworker.0 Request processed in 68us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.537659:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788797080.537713:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984680448:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537743:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537762:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788797080.537767:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875688984680320:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537787:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537803:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537829:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797080.537861:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680448 00000100:00100000:3.0:1788797080.537874:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680448 00000100:00100000:3.0:1788797080.537895:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797080.537900:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984680448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.537936:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984680448:12345-0@lo:400:kworker.0 Request processed in 36us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.537942:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788797080.537982:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984680192:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538023:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680960 00000100:00100000:3.0:1788797080.538027:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680960 00000100:00100000:3.0:1788797080.538061:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680832 00000100:00100000:3.0:1788797080.538063:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680832 00000100:00100000:3.0:1788797080.538075:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680320 00000100:00100000:3.0:1788797080.538078:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680320 00000100:00100000:3.0:1788797080.538088:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681088 00000100:00100000:3.0:1788797080.538090:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681088 00000100:00100000:3.0:1788797080.538108:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797080.538114:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984680960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538150:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984680960:12345-0@lo:400:kworker.0 Request processed in 36us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.538156:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797080.538167:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797080.538173:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984680832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538200:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984680832:12345-0@lo:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.538204:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788797080.538214:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797080.538218:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875688984680320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538256:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875688984680320:12345-0@lo:400:kworker.0 Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.538263:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797080.538275:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797080.538280:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984681088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538302:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984681088:12345-0@lo:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.538307:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788797080.538333:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb02300 x1875688984680320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.538343:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875688984680320:0@lo:400:kworker.0 00010000:00080000:3.0:1788797080.538352:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb02d80 x1875688984681088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.538359:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538366:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984680448:0@lo:400:kworker.0 00010000:00080000:3.0:1788797080.538387:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb01f80 x1875688984680832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.538395:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984680832:0@lo:400:kworker.0 00010000:00080000:3.0:1788797080.538403:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb01180 x1875688984680960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.538410:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984680960:0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538461:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680064 00000100:00100000:3.0:1788797080.538471:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680064 00000100:00100000:3.0:1788797080.538500:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788797080.538506:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3657:x1875688984680064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797080.538544:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3657:x1875688984680064:12345-0@lo:400:kworker.0 Request processed in 38us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.538550:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788797080.538589:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984680064:0@lo:400:kworker.0 00000100:00100000:2.0:1788797080.539616:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984680576:0@lo:8:kworker.0 00000100:00100000:2.0:1788797080.539715:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797080.539763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984680704:0@lo:8:kworker.0 00000100:00100000:2.0:1788797080.539790:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788797080.539832:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788797080.539838:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797080.539911:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680576 00000100:00100000:2.0:1788797080.539919:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680576 00000100:00100000:2.0:1788797080.539950:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984680704 00000100:00100000:2.0:1788797080.539953:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984680704 00000100:00100000:2.0:1788797080.539965:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797080.539972:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3653:x1875688984680576:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788797080.540022:0:24294:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 796 last 0 00000020:00000080:2.0:1788797080.540060:0:24294:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd2664e9 00002000:00100000:2.0:1788797080.540096:0:24294:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8fb3869d1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788797080.540101:0:24294:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788797080.540105:0:24294:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788797080.540336:0:24294:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788797080.540369:0:24294:0:(import.c:65:import_set_state_nolock()) ffff8fb3869d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797080.540425:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875688984680576:12345-0@lo:8:kworker.0 Request processed in 452us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797080.540433:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788797080.540451:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788797080.540456:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3653:x1875688984680704:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788797080.540469:0:24294:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788797080.544332:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb01500 x1875688984680576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.544354:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788797080.544371:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788797080.544385:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788797080.544393:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788797080.544397:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb4bd330800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788797080.544426:0:3653:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788797080.544435:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984680576:0@lo:8:kworker.0 00000004:00080000:0.0:1788797080.549007:0:23530:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788797080.549051:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681344:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788797080.549419:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797080.549467:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b0ec4cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788797080.549496:0:23529:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788797080.549623:0:23529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 796336941244ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788797080.549631:0:23529:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788797080.549708:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797080.549724:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984681216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797080.549756:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797080.549794:0:24293:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788797080.549804:0:24293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788797080.550803:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681216 00000100:00100000:0.0:1788797080.550819:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681216 00000100:00100000:0.0:1788797080.553308:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788797080.553335:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875688984681216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797080.553390:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797080.553528:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875688984681216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797080.553537:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788797080.553705:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788797080.554941:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd5880 x1875688984681216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.554978:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984681216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797080.555089:0:24295:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788797080.555108:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681344 00000100:00100000:3.0:1788797080.555117:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681344 00000100:00100000:1.0:1788797080.560546:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797080.560573:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23530:x1875688984681344:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788797080.572276:0:23521:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788797080.599764:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788797080.599787:0:24595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788797080.599948:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23530:x1875688984681344:12345-0@lo:7:osp-pre-0-1.0 Request processed in 39378us (50521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797080.599961:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788797080.600697:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd4000 x1875688984681344/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788797096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797080.600718:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681344:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788797080.600738:0:23530:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788797080.600800:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681472:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788797080.600897:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797080.600939:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb486108b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797080.601224:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3653:x1875688984680704:12345-0@lo:8:kworker.0 Request processed in 60764us (61429us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788797080.601249:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788797080.601299:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797080.601305:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788797080.601309:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984680704:0@lo:8:kworker.0 00000100:00100000:2.0:1788797080.601336:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681472 00000100:00100000:2.0:1788797080.601346:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681472 00000100:00100000:2.0:1788797080.601409:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788797080.601421:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23530:x1875688984681472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788797080.601456:0:24293:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788797080.607284:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23530:x1875688984681472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 5847us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797080.607308:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788797080.607554:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb2ce00 x1875688984681472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797080.607575:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681472:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788797080.607595:0:23530:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788797080.607671:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681600:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788797080.607776:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797080.607805:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b0ec4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797080.608134:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681600 00000100:00100000:2.0:1788797080.608145:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681600 00000100:00100000:2.0:1788797080.608213:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797080.608224:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23530:x1875688984681600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788797080.608304:0:24595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1788797080.651386:0:24289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788797080.651411:0:24289:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788797080.651990:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23530:x1875688984681600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43760us (44206us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788797080.652015:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788797080.652590:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd6300 x1875688984681600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797080.652605:0:23530:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788797080.652613:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23530:1875688984681600:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788797080.652649:0:23530:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788797080.652740:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875688984681728:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788797080.652800:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797080.652958:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4b0ec4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797080.656512:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681728 00000100:00100000:3.0:1788797080.656535:0:22799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681728 00000100:00100000:3.0:1788797080.656633:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788797080.656646:0:22799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875688984681728:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788797080.656840:0:22799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1875688984681728:12345-0@lo:900:osp-pre-0-1.0 Request processed in 197us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797080.656849:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788797080.656922:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd6300 x1875688984681728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797080.656943:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23530:1875688984681728:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788797080.725993:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797080.851954:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984681856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797080.852218:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797080.852350:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681856 00000100:00100000:1.0:1788797080.852362:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681856 00000100:00100000:1.0:1788797080.852425:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788797080.852436:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984681856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797080.852483:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797080.852539:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984681856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797080.852547:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788797080.852750:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984681856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797080.853236:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984681984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797080.853285:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797080.853373:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984681984 00000100:00100000:1.0:1788797080.853380:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984681984 00000100:00100000:1.0:1788797080.853420:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788797080.853429:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984681984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788797080.853460:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788797080.853509:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984681984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797080.853516:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788797080.853741:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984681984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788797081.109763:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788797081.750348:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788797082.594469:0:24660:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788797082.772999:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797083.796181:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788797084.012349:0:24712:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797084.013058:0:24712:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788797084.627765:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797064/real 1788797064] req@ffff8fb3881a1880 x1875688984670976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797084.627800:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a1880 x1875688984670976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797084.627810:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788797064/real 1788797064] req@ffff8fb3881a3480 x1875688984671104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797084.627822:0:3653:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fb3881a3480 x1875688984671104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788797084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797084.627855:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797084.627889:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797084.627893:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984670976:0@lo:8:kworker.0 00000100:00080000:2.0:1788797084.627899:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788797084.627905:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788797084.627908:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984671104:0@lo:8:kworker.0 00000100:00080000:0.0:1788797084.628067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797084.628071:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788797084.628074:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797084.628079:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 780 00000100:00080000:0.0:1788797084.628084:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788797084.628094:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fb49000d800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788797084.628111:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd4000 x1875688984682368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797084.628125:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797084.628128:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797084.628130:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797084.628132:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 780 00000100:00080000:0.0:1788797084.628134:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788797084.628138:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788797084.628158:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bacd5880 x1875688984682496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788797084.628194:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788797084.628196:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788797084.628198:0:38:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788797084.628201:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 796 00000100:00080000:0.0:1788797084.628204:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788797084.628208:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:0.0:1788797084.628218:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4b9ecaa00 x1875688984683008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797084.628273:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984682624:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.628330:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.628359:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984683264:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.628382:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.628400:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788797084.628405:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984682752:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.628426:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.628442:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984683392:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.628458:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.628504:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682624 00000100:00100000:0.0:1788797084.628512:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682624 00000100:00100000:0.0:1788797084.628547:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683264 00000100:00100000:0.0:1788797084.628550:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683264 00000100:00100000:0.0:1788797084.628977:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683392 00000100:00100000:0.0:1788797084.628981:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683392 00000100:00100000:0.0:1788797084.629001:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788797084.629020:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984682624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.629076:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984682624:12345-0@lo:400:kworker.0 Request processed in 58us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.629083:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788797084.629099:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788797084.629105:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984683264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.629130:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984683264:12345-0@lo:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.629135:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788797084.629145:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788797084.629150:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984683392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.629174:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984683392:12345-0@lo:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.629180:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788797084.629203:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682752 00000100:00100000:0.0:1788797084.629206:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682752 00000100:00100000:0.0:1788797084.629232:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788797084.629239:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984682752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629393:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984682112:0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629430:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797084.629482:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984682880:0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629510:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797084.629533:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788797084.629539:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629626:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797084.629641:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984683136:0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629661:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797084.629710:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682112 00000100:00100000:1.0:1788797084.629714:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682112 00000100:00100000:1.0:1788797084.629745:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788797084.629752:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3654:x1875688984682112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.629786:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3654:x1875688984682112:12345-0@lo:400:kworker.0 Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797084.629792:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788797084.629821:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682880 00000100:00100000:1.0:1788797084.629825:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682880 00000100:00100000:1.0:1788797084.629852:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797084.629859:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797084.631209:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984682880:12345-0@lo:400:kworker.0 Request processed in 1342us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797084.631220:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788797084.631279:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984682112:0@lo:400:kworker.0 00010000:00080000:1.0:1788797084.631296:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9eca300 x1875688984682880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797084.631309:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.631998:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984682752:12345-0@lo:400:kworker.0 Request processed in 33us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.632014:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788797084.632048:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682240 00000100:00100000:0.0:1788797084.632054:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682240 00000100:00100000:0.0:1788797084.632089:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788797084.632096:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.632184:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984682240:12345-0@lo:400:kworker.0 Request processed in 89us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.632199:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788797084.632222:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683136 00000100:00100000:0.0:1788797084.632227:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683136 00000100:00100000:0.0:1788797084.632256:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788797084.632261:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797084.632297:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984683136:12345-0@lo:400:kworker.0 Request processed in 36us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.632302:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788797084.632319:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797084.632325:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797084.632327:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797084.632427:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984682368:0@lo:8:kworker.0 00000100:00100000:0.0:1788797084.632469:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.632504:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bacd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984682496:0@lo:8:kworker.0 00000100:00100000:0.0:1788797084.632524:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.632539:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984683008:0@lo:8:kworker.0 00000100:00100000:0.0:1788797084.632599:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.632636:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682368 00000100:00100000:0.0:1788797084.632640:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682368 00000100:00100000:0.0:1788797084.632657:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984682496 00000100:00100000:0.0:1788797084.632660:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984682496 00000100:00100000:0.0:1788797084.632668:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683008 00000100:00100000:0.0:1788797084.632670:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683008 00000100:00100000:0.0:1788797084.632697:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797084.632703:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984682368:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788797084.632728:0:24295:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 800 last 0 00000020:00000080:0.0:1788797084.632759:0:24295:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd2664f0 00002000:00100000:0.0:1788797084.632779:0:24295:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fb3865ce000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788797084.632783:0:24295:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788797084.632786:0:24295:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788797084.632863:0:24295:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788797084.632888:0:24295:0:(import.c:65:import_set_state_nolock()) ffff8fb3865cd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797084.632941:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1875688984682368:12345-0@lo:8:kworker.0 Request processed in 236us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.632947:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797084.632962:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797084.632966:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984682496:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788797084.632979:0:24295:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797084.633005:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984682496:12345-0@lo:8:kworker.0 Request processed in 37us (480us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797084.633011:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797084.633023:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797084.633026:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984683008:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788797084.633034:0:24295:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797084.633070:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984683008:12345-0@lo:8:kworker.0 Request processed in 42us (470us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797084.633076:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797084.633115:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984682752:0@lo:400:kworker.0 00010000:00080000:0.0:1788797084.633129:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ec8700 x1875688984683392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797084.633139:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984683392:0@lo:400:kworker.0 00010000:00080000:0.0:1788797084.633150:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd5180 x1875688984682624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797084.633166:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984682624:0@lo:400:kworker.0 00010000:00080000:0.0:1788797084.633180:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecb800 x1875688984683264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797084.633188:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984683264:0@lo:400:kworker.0 00010000:00080000:0.0:1788797084.633231:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bacd4000 x1875688984682368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797084.633238:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797084.633245:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788797084.633252:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788797084.633256:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788797084.633259:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb49000d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788797084.633271:0:3653:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788797084.633275:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984682368:0@lo:8:kworker.0 00000100:00080000:0.0:1788797084.633285:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797084.633289:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797084.633291:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984682496:0@lo:8:kworker.0 00000100:00080000:0.0:1788797084.633298:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797084.633301:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797084.633303:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984683008:0@lo:8:kworker.0 00000004:00080000:0.0:1788797084.633352:0:22813:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788797084.633371:0:22813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875688984683648:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788797084.633397:0:22813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.633420:0:22813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd61e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797084.633433:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797084.633441:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984683520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797084.633467:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797084.633493:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683520 00000100:00100000:0.0:1788797084.633498:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683520 00000100:00100000:0.0:1788797084.633534:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788797084.633541:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984683520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797084.633560:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797084.633594:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984683520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.633601:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788797084.633615:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788797084.633632:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecaa00 x1875688984683520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797084.633646:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984683520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797084.633659:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683648 00000100:00100000:0.0:1788797084.633662:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683648 00000100:00100000:0.0:1788797084.633699:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797084.633705:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22813:x1875688984683648:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788797084.634170:0:22812:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788797084.634247:0:22812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 800421565499ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788797084.634253:0:22812:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788797084.634403:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bacd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984682240:0@lo:400:kworker.0 00010000:00080000:1.0:1788797084.634416:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4b9ecad80 x1875688984683136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797084.634424:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984683136:0@lo:400:kworker.0 00000004:00080000:1.0:1788797084.639773:0:22767:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788797084.647247:0:24295:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788797084.647264:0:24295:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788797084.647273:0:24295:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:1.0:1788797084.670143:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797084.670164:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.670187:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=800s v=(0 0) 00010000:00010000:1.0:1788797084.670192:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797084.670200:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.670224:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.670236:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.670243:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.670305:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797084.670632:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.670643:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.670653:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c5e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.670658:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.670668:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.670732:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.670739:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002101e478/0x500835b7bd2664f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.670768:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.670770:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.670773:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788797084.671801:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797084.671813:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.671827:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=800s v=(0 0) 00010000:00010000:1.0:1788797084.671832:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797084.671838:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.671850:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.671870:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.671886:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.671965:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788797084.672779:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797084.672787:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.672798:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=800s v=(0 0) 00010000:00010000:1.0:1788797084.672809:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797084.672814:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.672826:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.672835:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.672842:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673152:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797084.673162:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673171:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.673176:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673185:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673204:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673212:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3e4cd1/0x500835b7bd2664fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673230:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.673233:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673248:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c5a00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.673251:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673257:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673268:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.673276:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.673277:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.673280:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.678381:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788797084.678398:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb8cca8c/0x500835b7bd266505 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788797084.680397:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788797084.680411:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.680428:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=800s v=(0 0) 00010000:00010000:1.0:1788797084.680432:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797084.680439:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.680454:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.680548:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.680556:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.680779:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.680788:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.680797:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.680801:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.680810:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.680830:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.680840:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.680841:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.680843:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.686195:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788797084.686215:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3e1ba1/0x500835b7bd26650c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.689202:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.689221:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.689241:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.689246:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.689253:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.689272:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.689284:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.689293:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.691418:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.691435:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.691450:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682ec00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.691456:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.691480:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.691504:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.691528:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.691530:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.691532:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.691793:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.691802:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d07d90ff/0x500835b7bd266513 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.692647:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.692657:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.692672:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.692702:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.692709:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.692723:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.692732:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.692741:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.696257:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797084.696274:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.696283:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788797084.696293:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797084.696300:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.696312:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.696337:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.696344:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3e298d/0x500835b7bd26651a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.696381:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.696383:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.696384:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.696451:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.698759:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.698846:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.698866:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.698871:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.698878:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.698896:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.698907:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.698924:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.698963:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797084.699001:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797084.699010:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.699032:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682fc00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797084.699038:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.699047:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.699068:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.699076:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d8b6ed/0x500835b7bd266521 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.699096:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797084.699098:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797084.699100:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.699867:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.699876:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.699886:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.699890:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.699894:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.699905:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.699913:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.699920:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.699951:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797084.701663:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.701675:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701715:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.701718:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.701723:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701736:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701745:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701752:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701772:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797084.701782:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797084.701788:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701795:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.701801:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701809:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701838:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701845:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013d3e066/0x500835b7bd266528 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701874:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.701879:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701894:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682fe00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.701898:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701906:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701917:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701935:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079be69a2/0x500835b7bd26652f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.701949:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.701950:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.701958:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.702413:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.703072:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.703081:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703093:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.703096:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.703101:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703112:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703120:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703128:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703154:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797084.703450:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.703458:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.703478:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.703483:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.703492:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.703508:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.703515:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed251840/0x500835b7bd266536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.703535:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.703537:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.703538:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.703759:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.703766:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703775:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.703778:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.703782:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703809:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703819:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703827:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.703842:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797084.704251:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.704258:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704266:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.704269:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.704273:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704280:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704289:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704309:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704328:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797084.704338:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797084.704343:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704350:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682ee00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.704353:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704362:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704374:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704381:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d48c153a/0x500835b7bd26653d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704396:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.704400:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704417:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682fa00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.704421:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704428:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704440:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704447:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ee6f794/0x500835b7bd266544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.704460:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.704462:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.705280:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.706026:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.706650:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.706661:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.706676:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.706701:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.706707:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.706721:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.706738:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.706745:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.706765:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797084.707023:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.707035:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.707044:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.707049:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.707059:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.707073:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.707080:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962acd58/0x500835b7bd26654b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.707098:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.707100:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.707102:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.708082:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.708092:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.708104:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.708108:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.708114:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.708125:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.708133:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.708141:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.708215:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797084.711423:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.711441:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.711459:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.711476:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.711484:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.711499:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.711511:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.711520:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713424:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797084.713438:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713451:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.713456:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713553:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713635:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713643:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ce4000/0x500835b7bd266552 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713666:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.713670:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713676:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.713743:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713753:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713763:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.713770:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.713772:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.713780:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.714368:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.714376:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.715317:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.715326:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.715345:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.715349:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.715355:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.715368:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.715378:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.715385:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.715486:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.715493:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.715502:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.715506:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.715516:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.715531:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.715539:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.715540:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.715542:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.715830:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.715835:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.716367:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.716374:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.716384:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.716387:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.716391:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.716415:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.716423:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.716430:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.716461:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.716476:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.716484:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.716487:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.716496:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.716522:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.716531:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.716533:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.716534:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.716816:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.716822:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd266567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.717325:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.717332:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.717342:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.717345:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.717349:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.717360:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.717381:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.717389:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.719841:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.719868:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.719998:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.720005:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.720017:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.720039:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.720050:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.720052:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.720054:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.720298:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.720305:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26656e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.723408:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.723425:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.723443:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.723447:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.723452:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.724318:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.724339:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.724369:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.724568:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.724575:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.724597:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.724602:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.724613:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.724629:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.724638:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.724640:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.724642:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.725213:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.725220:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd266575 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.725255:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.726477:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.726488:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.726504:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.726518:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.726525:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.726538:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.726548:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.726556:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.726607:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797084.727229:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.727237:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.727246:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.727250:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.727259:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.727276:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.727292:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060e5b7f9/0x500835b7bd26657c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.727314:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.727316:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.727318:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.728233:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.728241:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728254:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.728258:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.728263:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728275:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728284:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728291:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728307:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797084.728314:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.728318:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728325:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.728335:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728343:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728356:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728363:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd266583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.728377:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.728379:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.728381:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.729297:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.729305:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.729316:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.729320:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.729324:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.729334:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.729342:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.729357:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.729379:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797084.730297:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797084.730305:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.730314:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797084.730319:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.730327:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.730344:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.730351:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054d866a4/0x500835b7bd26658a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.730368:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.730370:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.730372:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.731091:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.731102:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.731115:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.731119:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.731125:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.731136:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.731145:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.731153:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.732978:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797084.734308:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.734319:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.734344:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.734349:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.734356:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.734371:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.734381:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.734388:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.737899:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797084.737915:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.737939:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797084.737944:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.737956:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.737988:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.737997:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266591 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.738024:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797084.738027:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.738034:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797084.738037:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.738045:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.738055:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.738064:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797084.738065:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797084.738067:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.739829:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788797084.739843:0:24295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007301aded/0x500835b7bd266598 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797084.740005:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797084.741512:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.741525:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.741542:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.741547:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.741554:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.742652:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.742665:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.742673:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.742741:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788797084.743017:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797084.743027:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.743035:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797084.743041:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.743050:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.743071:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797084.743079:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842add8a/0x500835b7bd26659f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797084.746491:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.746517:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.746538:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.746544:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.746551:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.746576:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.746588:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.746609:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.746637:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797084.747507:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.747515:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.747527:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.747531:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.747535:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.747546:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.747554:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.747577:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.747587:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788797084.748042:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.748048:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748065:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.748067:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.748071:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748080:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748088:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748095:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748104:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788797084.748447:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.748454:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748474:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.748478:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.748481:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748490:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748510:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748517:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.748526:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788797084.749162:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797084.749169:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.749180:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=800s v=(0 0) 00010000:00010000:3.0:1788797084.749183:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797084.749188:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.749199:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.749208:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.749215:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.749236:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788797084.749420:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00002000:00010000:0.0:1788797084.750182:0:24295:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797084.750190:0:24295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.750209:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=800s v=(0 0) 00010000:00010000:0.0:1788797084.750212:0:24295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797084.750217:0:24295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.750228:0:24295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.750236:0:24295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.750243:0:24295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797084.750252:0:24295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1788797084.750297:0:24295:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1788797084.750400:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22813:x1875688984683648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116691us (116998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797084.750411:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788797084.750708:0:24734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1788797084.750802:0:22813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875688984683648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788797084.750817:0:22813:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788797084.751001:0:22813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875688984683776:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788797084.751046:0:22813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797084.751082:0:22813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4907006c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788797084.751200:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751210:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.751215:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751225:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751245:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751253:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075bb6170/0x500835b7bd2665a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751280:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788797084.751284:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751298:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.751302:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751310:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751322:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751329:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007320585c/0x500835b7bd2665b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751345:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788797084.751349:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751355:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.751358:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751366:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751376:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751391:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ada4e20/0x500835b7bd2665bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751406:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797084.751410:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751416:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.751419:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751427:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751437:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751445:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d77213/0x500835b7bd2665c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.751456:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797084.751461:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797084.751756:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683776 00000100:00100000:0.0:1788797084.751764:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683776 00000100:00100000:0.0:1788797084.751821:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797084.751831:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22813:x1875688984683776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788797084.752017:0:24294:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1788797084.753099:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.753103:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797084.753105:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.755784:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.755799:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.755811:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.755833:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.755841:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c3a7cce/0x500835b7bd2665c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.759677:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.759704:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.759708:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788797084.760050:0:24289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788797084.760112:0:24289:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788797084.760824:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22813:x1875688984683776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8988us (9770us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788797084.760836:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788797084.761101:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.761105:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797084.761107:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.761145:0:24734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.761160:0:24734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797084.761165:0:24734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.761178:0:24734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.761223:0:24734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.761232:0:24734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f670d5a/0x500835b7bd2665ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797084.761261:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.761263:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797084.761265:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797084.761343:0:22813:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788797084.761361:0:22813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22813:1875688984683776:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788797084.761378:0:22813:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1788797084.832190:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788797085.283452:0:24764:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788797085.284208:0:24764:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797085.846138:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797085.972089:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984683904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797085.972168:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797085.972226:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984684032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797085.972250:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797085.972270:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797085.972276:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984684160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797085.972299:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797085.972331:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984683904 00000100:00100000:3.0:1788797085.972338:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984683904 00000100:00100000:3.0:1788797085.972375:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684032 00000100:00100000:3.0:1788797085.972378:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684032 00000100:00100000:3.0:1788797085.972393:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797085.972881:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984683904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797085.972933:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797085.972989:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984683904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 588us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797085.973002:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788797085.973024:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788797085.973031:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984684032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797085.973049:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797085.973085:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984684032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797085.973091:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788797085.973119:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684160 00000100:00100000:3.0:1788797085.973124:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684160 00000100:00100000:3.0:1788797085.973150:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797085.973157:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984684160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788797085.973170:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788797085.973197:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984684160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797085.973203:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797085.973242:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984684160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797085.973253:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984684032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797085.973284:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984683904:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788797086.867816:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788797087.061914:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797087.906818:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797088.915858:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797089.946455:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797090.075591:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797090.075599:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797090.075603:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797090.075612:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 800 00000100:00080000:1.0:1788797090.075618:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788797090.075629:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797090.075651:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb2ea00 x1875688984684672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797090.075719:0:21075:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797090.075722:0:21075:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797090.075724:0:21075:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797090.075728:0:21075:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 800 00000100:00080000:1.0:1788797090.075730:0:21075:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788797090.075735:0:21075:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797090.075746:0:21075:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfb2d180 x1875688984685184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788797090.075803:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984684416:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.075917:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.075981:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984685056:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076006:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076030:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788797090.076036:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984684288:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076064:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076088:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984684928:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076108:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076134:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984685568:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076160:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076305:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984684800:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076332:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076352:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984685440:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076371:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076389:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797090.076394:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984684544:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076415:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076430:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984685312:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076447:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076465:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984684672:0@lo:8:kworker.0 00000100:00100000:1.0:1788797090.076487:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076503:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984685184:0@lo:8:kworker.0 00000100:00100000:1.0:1788797090.076527:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797090.076559:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684416 00000100:00100000:1.0:1788797090.076565:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684416 00000100:00100000:1.0:1788797090.076597:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684928 00000100:00100000:1.0:1788797090.076600:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684928 00000100:00100000:1.0:1788797090.076613:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788797090.076621:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984684416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076668:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984684416:12345-0@lo:400:kworker.0 Request processed in 48us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.076674:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788797090.076720:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788797090.076727:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984684928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076765:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984684928:12345-0@lo:400:kworker.0 Request processed in 38us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.076771:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788797090.076790:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685056 00000100:00100000:1.0:1788797090.076794:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685056 00000100:00100000:1.0:1788797090.076821:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684544 00000100:00100000:1.0:1788797090.076823:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684544 00000100:00100000:1.0:1788797090.076846:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684672 00000100:00100000:1.0:1788797090.076848:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684672 00000100:00100000:1.0:1788797090.076856:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685184 00000100:00100000:1.0:1788797090.076858:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685184 00000100:00100000:1.0:1788797090.076866:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797090.076872:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984685056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.076902:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984685056:12345-0@lo:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.076907:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788797090.076918:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797090.076924:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984684544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.077196:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797090.077203:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984684672:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788797090.077223:0:24295:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797090.077262:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984684672:12345-0@lo:8:kworker.0 Request processed in 58us (774us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797090.077269:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797090.077284:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788797090.077288:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984685184:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788797090.077298:0:24295:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788797090.077320:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984685184:12345-0@lo:8:kworker.0 Request processed in 31us (793us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788797090.077325:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788797090.077458:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984684544:12345-0@lo:400:kworker.0 Request processed in 534us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.077465:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788797090.077485:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684288 00000100:00100000:1.0:1788797090.077489:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684288 00000100:00100000:1.0:1788797090.077514:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797090.077521:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3655:x1875688984684288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.077551:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3655:x1875688984684288:12345-0@lo:400:kworker.0 Request processed in 30us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.077566:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788797090.077600:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685568 00000100:00100000:1.0:1788797090.077604:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685568 00000100:00100000:1.0:1788797090.077625:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984684800 00000100:00100000:1.0:1788797090.077628:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984684800 00000100:00100000:1.0:1788797090.077639:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685440 00000100:00100000:1.0:1788797090.077641:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685440 00000100:00100000:1.0:1788797090.077652:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685312 00000100:00100000:1.0:1788797090.077654:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685312 00000100:00100000:1.0:1788797090.077664:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797090.077669:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984685568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.077942:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797090.077965:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984685696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797090.082260:0:22788:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788797090.082285:0:22788:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788797090.082316:0:22787:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788797090.082341:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788797090.082358:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984684800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.085246:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984684544:0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.085311:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797090.085355:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685696 00000100:00100000:0.0:1788797090.085363:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685696 00000100:00100000:0.0:1788797090.085414:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797090.085424:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984685696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797090.085460:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797090.085510:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984685696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797090.085517:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797090.085563:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984685696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797090.085746:0:24940:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788797090.085753:0:24940:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1788797090.088283:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797090.088293:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797090.088296:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797090.088344:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797090.088352:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797090.088357:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984684672:0@lo:8:kworker.0 00000100:00080000:0.0:1788797090.088371:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797090.088374:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788797090.088377:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984685184:0@lo:8:kworker.0 00000100:00100000:0.0:1788797090.088417:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984684288:0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.088430:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984684928:0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.088441:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984684416:0@lo:400:kworker.0 00000100:00100000:0.0:1788797090.088454:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984685056:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.089452:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984685568:12345-0@lo:400:kworker.0 Request processed in 11777us (13286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.089465:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788797090.089527:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb2dc00 x1875688984685568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797090.089538:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984685568:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.089567:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797090.089578:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984685440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.089644:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984685440:12345-0@lo:400:kworker.0 Request processed in 69us (13271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.089650:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788797090.089697:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb2c000 x1875688984685440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797090.089718:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984685440:0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.089738:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788797090.089753:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bacd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984685312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797090.089805:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984685312:12345-0@lo:400:kworker.0 Request processed in 53us (13356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797090.089810:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788797090.089843:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb2df80 x1875688984685312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797090.089852:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984685312:0@lo:400:kworker.0 00000100:00100000:3.0:1788797090.090480:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bacd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984684800:12345-0@lo:400:kworker.0 Request processed in 8125us (14143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797090.090488:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788797090.102538:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb2e680 x1875688984684800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797090.102557:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984684800:0@lo:400:kworker.0 00010000:00010000:3.0:1788797090.966129:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797091.092833:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984685824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797091.092904:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797091.092960:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685824 00000100:00100000:3.0:1788797091.092966:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685824 00000100:00100000:3.0:1788797091.093011:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797091.093019:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984685824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797091.093051:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797091.093087:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984685824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797091.093094:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788797091.093150:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984685824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797091.093361:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984685952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788797091.093388:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797091.093448:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984685952 00000100:00100000:3.0:1788797091.093453:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984685952 00000100:00100000:3.0:1788797091.093481:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788797091.093487:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984685952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797091.093505:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797091.093538:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984685952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797091.093543:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788797091.097110:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984685952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797091.097595:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788797091.097610:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984686080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797091.097673:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797091.097833:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686080 00000100:00100000:0.0:1788797091.097841:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686080 00000100:00100000:0.0:1788797091.097893:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788797091.097902:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984686080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797091.097922:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797091.097963:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984686080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797091.097979:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797091.098143:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984686080:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788797091.349382:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788797091.991134:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797093.020293:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788797093.481993:0:25111:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788797093.481997:0:25111:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788797093.481999:0:25111:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788797093.482111:0:25111:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fb388872000 00000020:01000004:1.0:1788797093.482127:0:25111:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788797093.482140:0:25111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788797093.482165:0:25111:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fb387694d28) 00000020:00000080:1.0:1788797093.482183:0:25111:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788797093.606964:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788797093.612547:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788797093.613743:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788797093.614333:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788797093.623204:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788797093.623569:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788797093.623990:0:25111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788797093.627209:0:25111:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788797093.628028:0:25111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788797093.628044:0:25111:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788797093.628058:0:25111:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x500835b7bd2665d7 00000020:01000004:3.0:1788797093.628065:0:25111:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788797093.628091:0:25111:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788797093.628095:0:25111:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788797093.628101:0:25111:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788797093.628137:0:25111:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788797093.628142:0:25111:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788797093.675832:0:25111:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788797093.675887:0:25111:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788797093.675892:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788797093.675894:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797093.675896:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797093.675897:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797093.675898:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797093.675899:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797093.675901:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797093.675903:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797093.675905:0:25111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797093.675908:0:25111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788797093.675911:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788797093.675912:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797093.675919:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797093.675920:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797093.675921:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797093.675922:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797093.675922:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797093.675923:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797093.675924:0:25111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788797093.675954:0:25111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788797093.675975:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788797093.676044:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.676092:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd3e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.676727:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686208 00000100:00100000:1.0:1788797093.676736:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686208 00000100:00100000:1.0:1788797093.676814:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788797093.676826:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:25111:x1875688984686208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788797093.676860:0:22781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788797093.676873:0:22781:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788797093.676878:0:22781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788797093.677464:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:25111:x1875688984686208:12345-0@lo:253:mount.lustre.0 Request processed in 639us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.677474:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788797093.677623:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788797093.677634:0:25111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788797093.677637:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788797093.677638:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788797093.677640:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788797093.677641:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788797093.677642:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788797093.677643:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788797093.677644:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788797093.677645:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788797093.677646:0:25111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788797093.677666:0:25111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fb388872000 from lustre-OST0001 10000000:01000000:2.0:1788797093.677738:0:25111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788797093.677741:0:25111:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788797093.677752:0:25111:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fb3875b3370 local copy 00010000:00010000:2.0:1788797093.677763:0:25111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797093.678004:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788797093.678043:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.678080:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd3e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.678210:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686336 00000100:00100000:1.0:1788797093.678216:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686336 00000100:00100000:1.0:1788797093.678253:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788797093.678262:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:25111:x1875688984686336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797093.678333:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:25111:x1875688984686336:12345-0@lo:501:mount.lustre.0 Request processed in 71us (289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788797093.678340:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788797093.678934:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788797093.678963:0:25111:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788797093.678982:0:25111:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788797093.678990:0:25111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.679000:0:25111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1a00/0x500835b7bd266211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266218 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.679027:0:25111:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fb388872000 10000000:01000000:2.0:1788797093.679032:0:25111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788797093.679037:0:25111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788797093.679040:0:25111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788797093.679045:0:25111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788797093.679047:0:25111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788797093.679071:0:25111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.679079:0:25111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.679088:0:25111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797093.679102:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797093.679131:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.679161:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd3e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.679244:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686464 00000100:00100000:1.0:1788797093.679250:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686464 00000100:00100000:1.0:1788797093.679286:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788797093.679293:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:25111:x1875688984686464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797093.679303:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797093.679314:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2665e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2665de expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.679336:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2665e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2665de expref: 22 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.679347:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb3881c4000/0x500835b7bd2665e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2665de expref: 22 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.679355:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb3881c4000, rc 0) 00000100:00100000:3.0:1788797093.687421:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788797093.687454:0:25111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2665e5 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.687466:0:25111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd2665e5 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.688063:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686464:12345-0@lo:101:mount.lustre.0 Request processed in 8767us (8928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.688083:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000040:00080000:0.0:1788797093.692757:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788797093.693629:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788797093.696030:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788797093.696072:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788797093.696080:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788797093.696087:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788797093.696094:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788797093.696101:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788797093.696113:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788797093.696129:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788797093.696142:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788797093.696183:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788797093.696190:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788797093.696300:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797093.696373:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.696460:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb487b29180 going to sleep for 11 seconds 00000100:00100000:3.0:1788797093.697344:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686592 00000100:00100000:3.0:1788797093.697354:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686592 00000100:00100000:0.0:1788797093.697525:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788797093.697532:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797093.697706:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686592:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.697712:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788797093.697809:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797093.697854:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797093.697903:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.697936:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797093.697944:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686720 00000100:00100000:3.0:1788797093.697948:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686720 00000100:00100000:3.0:1788797093.698015:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788797093.698022:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788797093.698752:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686720:12345-0@lo:503:mount.lustre.0 Request processed in 728us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797093.698760:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788797093.698825:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788797093.699262:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797093.699359:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797093.700209:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.700246:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797093.700514:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686848 00000100:00100000:2.0:1788797093.700523:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686848 00000100:00100000:2.0:1788797093.700580:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788797093.700601:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797093.701253:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686848:12345-0@lo:502:mount.lustre.0 Request processed in 653us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.701262:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788797093.705122:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797093.705548:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788797093.705582:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788797093.705594:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788797093.705607:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788797093.705620:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788797093.705632:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788797093.705644:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788797093.705657:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788797093.705670:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788797093.705810:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797093.705889:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.705933:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797093.705961:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984686976 00000100:00100000:3.0:1788797093.705970:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984686976 00000100:00100000:3.0:1788797093.706035:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788797093.706044:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788797093.706192:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984686976:12345-0@lo:502:mount.lustre.0 Request processed in 149us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797093.706200:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788797093.706350:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984686976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797093.706422:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788797093.706433:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788797093.708091:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788797093.708103:0:25115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788797093.708110:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.708124:0:25115:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788797093.708132:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788797093.708161:0:25115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fb4889e19b8) 00000020:00000080:0.0:1788797093.708189:0:25115:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788797093.708202:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788797093.708270:0:25115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb388872000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788797093.708280:0:25115:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788797093.708287:0:25115:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x500835b7bd2665f3 00010000:00010000:0.0:1788797093.711393:0:25115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788797093.712240:0:25115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788797093.713627:0:25115:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788797093.725174:0:25115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788797093.725187:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797093.725194:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.725196:0:25115:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788797093.725200:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797093.725204:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.725206:0:25115:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788797093.725210:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788797093.725212:0:25115:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788797093.725216:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797093.725219:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.725220:0:25115:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788797093.725224:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788797093.725227:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.725228:0:25115:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788797093.725233:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788797093.725275:0:25115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788797093.725278:0:25115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788797093.725280:0:25115:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788797093.725283:0:25115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788797093.725514:0:25111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788797093.725549:0:25111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788797093.725611:0:25111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2665e5 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.725634:0:25111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29da00/0x500835b7bd2665de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd2665e5 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788797093.725642:0:25111:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb388872000 from 1 10000000:01000000:1.0:1788797093.725645:0:25111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797093.725835:0:25111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.725844:0:25111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.725857:0:25111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.725881:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788797093.725952:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.725987:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788797093.726276:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687104 00000100:00100000:2.0:1788797093.726284:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687104 00000100:00100000:2.0:1788797093.726356:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788797093.726381:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:25111:x1875688984687104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788797093.726395:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797093.726415:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd2665fa expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.726439:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.726451:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.726459:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4be29ca00, rc 0) 00000100:00100000:2.0:1788797093.726507:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687104:12345-0@lo:101:mount.lustre.0 Request processed in 143us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.726515:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788797093.726591:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788797093.726615:0:25111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797093.726635:0:25111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788797093.737390:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788797093.737803:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788797093.738377:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788797093.738407:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788797093.738421:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788797093.738436:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788797093.738449:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788797093.738816:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788797093.738840:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788797093.738855:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788797093.738868:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788797093.738880:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788797093.738894:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788797093.738915:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788797093.738921:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788797093.739342:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788797093.739404:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.743301:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb385967900 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.746621:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687232 00000100:00100000:1.0:1788797093.746640:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687232 00000100:00100000:1.0:1788797093.746836:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788797093.746848:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797093.747040:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687232:12345-0@lo:501:mount.lustre.0 Request processed in 195us (7635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.747047:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788797093.747785:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797093.747843:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788797093.747899:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.747930:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb482956780 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.748365:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687360 00000100:00100000:1.0:1788797093.748387:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687360 00000100:00100000:1.0:1788797093.748526:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788797093.748545:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797093.749018:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687360:12345-0@lo:503:mount.lustre.0 Request processed in 473us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.749026:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788797093.749275:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788797093.750852:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788797093.750973:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788797093.751044:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.751094:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd3e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.751182:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687488 00000100:00100000:1.0:1788797093.751190:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687488 00000100:00100000:1.0:1788797093.751241:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788797093.751251:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797093.751365:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687488:12345-0@lo:502:mount.lustre.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.751534:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797093.751919:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788797093.751951:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788797093.751964:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788797093.751977:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788797093.752003:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788797093.752017:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788797093.752027:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788797093.752038:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788797093.752048:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788797093.752058:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788797093.752068:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788797093.752098:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ec9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.752151:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.752181:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb482956480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797093.752200:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687616 00000100:00100000:0.0:1788797093.752205:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687616 00000100:00100000:0.0:1788797093.752227:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788797093.752233:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984687616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.752326:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984687616:12345-0@lo:502:mount.lustre.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.752333:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788797093.752362:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ec9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788797093.752413:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788797093.752422:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1788797093.752701:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000020:01000000:3.0:1788797093.759248:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797093.759320:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759322:0:25119:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788797093.759349:0:25119:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb388872000 00000020:00000080:3.0:1788797093.759352:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797093.759360:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797093.759362:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759364:0:25119:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788797093.759366:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797093.759369:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759371:0:25119:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788797093.759374:0:25119:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fb388872000 00000020:00000080:3.0:1788797093.759376:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797093.759449:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797093.759452:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759454:0:25119:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788797093.759456:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797093.759521:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759523:0:25119:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788797093.759529:0:25119:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb388872000 00000020:00000080:3.0:1788797093.759531:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797093.759554:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797093.759557:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759558:0:25119:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788797093.759561:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788797093.759563:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759565:0:25119:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788797093.759569:0:25119:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fb388872000 00000020:00000080:3.0:1788797093.759571:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788797093.759592:0:25119:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788797093.759596:0:25119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788797093.759597:0:25119:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788797093.759601:0:25119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788797093.760806:0:25111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788797093.760844:0:25111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797093.760870:0:25111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.760886:0:25111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797093.760947:0:25111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788797093.760951:0:25111:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fb388872000 10000000:01000000:2.0:1788797093.760954:0:25111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fb388872000 10000000:01000000:2.0:1788797093.760959:0:25111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788797093.760966:0:25111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fb388872000 from 1 10000000:01000000:2.0:1788797093.760968:0:25111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788797093.761009:0:25111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.761018:0:25111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.761030:0:25111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797093.761057:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788797093.761134:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.761242:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd3e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.774841:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687744 00000100:00100000:1.0:1788797093.774856:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687744 00000100:00100000:1.0:1788797093.774919:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788797093.774930:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:25111:x1875688984687744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797093.774947:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797093.774967:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd26660f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266608 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.774997:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd26660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266608 expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.775009:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb3881c5a00/0x500835b7bd26660f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266608 expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.775019:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb3881c5a00, rc 0) 00000100:00100000:1.0:1788797093.775101:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984687744:12345-0@lo:101:mount.lustre.0 Request processed in 172us (13966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.775120:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788797093.775175:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788797093.775195:0:25111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26660f expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.775205:0:25111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26660f expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788797093.777844:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788797093.778195:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788797093.778848:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788797093.778880:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788797093.778913:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788797093.778926:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788797093.778938:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788797093.778949:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788797093.778960:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788797093.778972:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788797093.778983:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788797093.778994:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788797093.779006:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788797093.779018:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788797093.779031:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788797093.779044:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788797093.779057:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788797093.779069:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788797093.779082:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788797093.779096:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788797093.779123:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788797093.779139:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788797093.779164:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788797093.779177:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788797093.779189:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788797093.779202:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788797093.779214:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788797093.779226:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788797093.779237:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788797093.779248:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788797093.779259:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788797093.779270:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788797093.779281:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788797093.779291:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788797093.779302:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788797093.779313:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788797093.779339:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788797093.779353:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788797093.779383:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788797093.783290:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788797093.783348:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788797093.783364:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788797093.783391:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788797093.783546:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788797093.783563:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788797093.783580:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788797093.783663:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788797093.783699:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788797093.783791:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788797093.783805:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788797093.784000:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788797093.784034:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788797093.784055:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788797093.784061:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788797093.784172:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797093.784247:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.784292:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3879a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797093.784946:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984687872 00000100:00100000:0.0:1788797093.784955:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984687872 00000100:00100000:0.0:1788797093.785024:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788797093.785035:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984687872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788797093.785192:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984687872:12345-0@lo:501:mount.lustre.0 Request processed in 158us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.785200:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788797093.787316:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984687872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788797093.787389:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797093.787488:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.787529:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3879a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.787556:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688000 00000100:00100000:1.0:1788797093.787564:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688000 00000100:00100000:1.0:1788797093.787623:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788797093.787632:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788797093.787899:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688000:12345-0@lo:503:mount.lustre.0 Request processed in 268us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.787908:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788797093.787960:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788797093.788662:0:25111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788797093.788928:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797093.789003:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.789025:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3879a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797093.789054:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688128 00000100:00100000:1.0:1788797093.789060:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688128 00000100:00100000:1.0:1788797093.789095:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788797093.789104:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788797093.789278:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688128:12345-0@lo:502:mount.lustre.0 Request processed in 174us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.789301:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788797093.790845:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788797093.791107:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788797093.791139:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788797093.791154:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788797093.791167:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788797093.791180:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788797093.791191:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788797093.791202:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788797093.791213:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788797093.791223:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788797093.791237:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788797093.791248:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788797093.791258:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788797093.791290:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788797093.791305:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788797093.791316:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788797093.791329:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788797093.791341:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788797093.791354:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788797093.791366:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788797093.794948:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788797093.794970:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788797093.794986:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788797093.795001:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788797093.795019:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788797093.795036:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788797093.795053:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788797093.795072:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788797093.795090:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788797093.795128:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788797093.795146:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788797093.795162:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788797093.795189:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788797093.795207:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788797093.795225:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788797093.795241:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788797093.795254:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788797093.795266:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788797093.795278:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788797093.795290:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788797093.795301:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788797093.795313:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788797093.795323:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788797093.795335:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788797093.795346:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788797093.795373:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788797093.795387:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788797093.806168:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788797093.806233:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788797093.806301:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.806496:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.806546:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688256 00000100:00100000:0.0:1788797093.806554:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688256 00000100:00100000:0.0:1788797093.806673:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788797093.806777:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.806894:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688256:12345-0@lo:502:mount.lustre.0 Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.806903:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788797093.806964:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb482956240 going to sleep for 11 seconds 00000100:00100000:0.0:1788797093.806987:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797093.807905:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788797093.807947:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788797093.807982:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.808038:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.808060:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb482956240 going to sleep for 11 seconds 00000100:00100000:0.0:1788797093.808085:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688384 00000100:00100000:0.0:1788797093.808092:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688384 00000100:00100000:0.0:1788797093.808128:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788797093.808137:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788797093.808225:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984688384:12345-0@lo:502:mount.lustre.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.808233:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788797093.808283:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984688384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788797093.808321:0:25111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788797093.808329:0:25111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788797093.817117:0:25124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788797093.817139:0:25124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fb4bab6cd28) 00000020:00000080:3.0:1788797093.817168:0:25124:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788797093.817262:0:25124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb388872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788797093.817267:0:25124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb388872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788797093.817269:0:25124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb388872000 3 00010000:00080000:3.0:1788797093.817301:0:25124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb3869d1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.127@tcp at head 00010000:00010000:3.0:1788797093.820248:0:25124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788797093.820483:0:25124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788797093.820530:0:25124:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788797093.820544:0:25124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x500835b7bd26661d 00000100:00080000:3.0:1788797093.820555:0:25124:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788797093.820567:0:25124:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fb3869d1000 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797093.820604:0:25124:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfa75f80 x1875688984688512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797093.836933:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984688512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797093.837011:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797093.837114:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688512 00000100:00100000:2.0:1788797093.837123:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688512 00000100:00100000:2.0:1788797093.837168:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797093.837176:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1875688984688512:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788797093.837214:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:2.0:1788797093.837263:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x500835b7bd266624 00000004:00100000:2.0:1788797093.837280:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788797093.837319:0:22788:0:(import.c:65:import_set_state_nolock()) ffff8fb484296800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797093.837385:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875688984688512:12345-0@lo:38:llog_process_th.0 Request processed in 208us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.837394:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788797093.837988:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfa75f80 x1875688984688512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797093.838001:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797093.838009:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788797093.838017:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797093.838024:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788797093.838026:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3869d1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797093.838033:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3653:1875688984688512:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788797093.839850:0:25124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788797093.840183:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797093.840188:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797093.840192:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797093.840199:0:505:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 805 00000100:00080000:3.0:1788797093.840204:0:505:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788797093.840216:0:505:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797093.840239:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfa77b80 x1875688984688896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788797093.840274:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788797093.840277:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788797093.840278:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788797093.840282:0:505:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 805 00000100:00080000:3.0:1788797093.840284:0:505:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788797093.840288:0:505:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:3.0:1788797093.840326:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb4bfa77800 x1875688984689408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788797093.840524:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984688640:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.840589:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.840644:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984689280:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.840666:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.840819:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788797093.840826:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984689152:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.840852:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.840869:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984689792:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.840889:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.840921:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689280 00000100:00100000:0.0:1788797093.840928:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689280 00000100:00100000:0.0:1788797093.840979:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797093.840988:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984689280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.841039:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984689280:12345-0@lo:400:kworker.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.841046:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788797093.841075:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688640 00000100:00100000:0.0:1788797093.841079:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688640 00000100:00100000:0.0:1788797093.841096:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689152 00000100:00100000:0.0:1788797093.841100:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689152 00000100:00100000:0.0:1788797093.841112:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788797093.841119:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984688640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.841151:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984688640:12345-0@lo:400:kworker.0 Request processed in 33us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.841157:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788797093.841168:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788797093.841173:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984689152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.841199:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984689152:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.841214:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788797093.841230:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797093.841247:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984688896:0@lo:8:kworker.0 00000100:00100000:0.0:1788797093.841274:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.841291:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984689408:0@lo:8:kworker.0 00000100:00100000:0.0:1788797093.841328:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.841393:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984689152:0@lo:400:kworker.0 00000100:00100000:3.0:1788797093.841520:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984688768:0@lo:400:kworker.0 00000100:00100000:3.0:1788797093.841553:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.841574:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984689536:0@lo:400:kworker.0 00000100:00100000:3.0:1788797093.841673:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.841922:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788797093.841929:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984689024:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.841996:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984688640:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.842008:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984689280:0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.842036:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689792 00000100:00100000:0.0:1788797093.842041:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689792 00000100:00100000:0.0:1788797093.842076:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689536 00000100:00100000:0.0:1788797093.842079:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689536 00000100:00100000:0.0:1788797093.842099:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788797093.842106:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984689792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797093.842242:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788797093.842252:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984689536:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1788797093.845506:0:25124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788797093.845532:0:25124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8fb4bbe5cd28) 00000020:00000080:2.0:1788797093.845571:0:25124:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788797093.845720:0:25124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fb388872000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788797093.845726:0:25124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fb388872000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788797093.845728:0:25124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fb388872000 3 00010000:00080000:2.0:1788797093.845775:0:25124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fb3868d7800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.127@tcp at head 00010000:00010000:2.0:1788797093.847383:0:25124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788797093.847592:0:25124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788797093.847633:0:25124:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788797093.847645:0:25124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x500835b7bd266632 00000100:00080000:2.0:1788797093.847656:0:25124:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788797093.847668:0:25124:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8fb3868d7800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:2.0:1788797093.847731:0:25124:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb387b90380 x1875688984689920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788797093.847756:0:25124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788797093.849003:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688896 00000100:00100000:2.0:1788797093.849021:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688896 00000100:00100000:2.0:1788797093.849092:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689408 00000100:00100000:2.0:1788797093.849102:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689408 00000100:00100000:2.0:1788797093.849113:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984688768 00000100:00100000:2.0:1788797093.849116:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984688768 00000100:00100000:2.0:1788797093.849149:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797093.849160:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984688768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797093.849258:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984688768:12345-0@lo:400:kworker.0 Request processed in 99us (7703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.849265:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788797093.849281:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797093.849285:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3653:x1875688984688896:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788797093.849331:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3653:x1875688984688896:12345-0@lo:8:kworker.0 Request processed in 44us (8056us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788797093.849338:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797093.849349:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788797093.849352:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3653:x1875688984689408:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788797093.854271:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.854326:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984689664:0@lo:400:kworker.0 00000100:00100000:3.0:1788797093.854363:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.854947:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689024 00000100:00100000:0.0:1788797093.854960:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689024 00000100:00100000:0.0:1788797093.855012:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689664 00000100:00100000:0.0:1788797093.855015:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689664 00000100:00100000:0.0:1788797093.855040:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797093.855050:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984689024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.855113:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984689024:12345-0@lo:400:kworker.0 Request processed in 65us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.855120:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788797093.855143:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788797093.855166:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984689664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797093.855197:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984689664:12345-0@lo:400:kworker.0 Request processed in 33us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.855203:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788797093.855307:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797093.855313:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797093.855316:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788797093.855897:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3653:1875688984689920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797093.855940:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.855992:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797093.856003:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797093.856007:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788797093.856010:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984688896:0@lo:8:kworker.0 00000100:00100000:0.0:1788797093.856042:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984689920 00000100:00100000:0.0:1788797093.856047:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984689920 00000100:00100000:0.0:1788797093.856068:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797093.856073:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3653:x1875688984689920:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788797093.856099:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:0.0:1788797093.856149:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x500835b7bd266639 00000004:00100000:0.0:1788797093.856164:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788797093.856197:0:22788:0:(import.c:65:import_set_state_nolock()) ffff8fb4be921000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797093.856240:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875688984689920:12345-0@lo:38:llog_process_th.0 Request processed in 165us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797093.856246:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788797093.856279:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb387b90380 x1875688984689920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788797103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797093.856299:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797093.856304:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788797093.856312:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788797093.856316:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788797093.856318:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3868d7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788797093.856323:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3653:1875688984689920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788797093.856363:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984689792:12345-0@lo:400:kworker.0 Request processed in 14257us (15472us total) trans 0 rc 0/0 00010000:00080000:3.0:1788797093.856960:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfa76a00 x1875688984689664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797093.856972:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984689664:0@lo:400:kworker.0 00000100:00100000:3.0:1788797093.856985:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984688768:0@lo:400:kworker.0 00010000:00080000:3.0:1788797093.857010:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfa74a80 x1875688984689024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797093.857019:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984689024:0@lo:400:kworker.0 00000100:00100000:2.0:1788797093.857858:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3653:x1875688984689408:12345-0@lo:8:kworker.0 Request processed in 8499us (16524us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788797093.857869:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788797093.858510:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788797093.858566:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfb02a00 x1875688984689792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797093.858577:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984689792:0@lo:400:kworker.0 00000100:00100000:1.0:1788797093.858932:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875688984689536:12345-0@lo:400:kworker.0 Request processed in 16680us (17256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797093.858941:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788797093.860545:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788797093.860557:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788797093.860564:0:3653:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788797093.860569:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984689408:0@lo:8:kworker.0 00010000:00080000:2.0:1788797093.860754:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fb4bfa74380 x1875688984689536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797093.860777:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875688984689536:0@lo:400:kworker.0 00000040:00080000:2.0:1788797093.860902:0:25124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788797093.861112:0:25111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788797093.861142:0:25111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788797093.861166:0:25111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26660f expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797093.861177:0:25111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4be29d400/0x500835b7bd266608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26660f expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788797093.861233:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788797093.861240:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788797093.861241:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797093.861243:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797093.861244:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797093.861245:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797093.861246:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797093.861248:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797093.861249:0:25111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797093.861253:0:25111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788797093.861255:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788797093.861256:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788797093.861257:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797093.861258:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797093.861258:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797093.861259:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797093.861260:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797093.861261:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797093.861262:0:25111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788797093.861285:0:25111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788797093.861303:0:25111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984690048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788797093.861365:0:25111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797093.862820:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690048 00000100:00100000:0.0:1788797093.862831:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690048 00000100:00100000:0.0:1788797093.862890:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788797093.862899:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984690048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788797093.862927:0:22781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788797093.862941:0:22781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788797093.863068:0:25111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb482956900 going to sleep for 11 seconds 20000000:01000000:0.0:1788797093.888069:0:22781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788797093.888091:0:22781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788797093.888349:0:22804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788797093.888355:0:22804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788797093.888399:0:22804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888420:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2664cd expref: 24 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888428:0:22804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2664db expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888455:0:22804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888502:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888516:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 24 pid: 22779 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.888535:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984690176:0@lo:104: 00000100:00100000:1.0:1788797093.888617:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788797093.888670:0:22804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 24 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.888704:0:22804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 24 pid: 22782 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.888890:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984690304:0@lo:104: 00000100:00100000:1.0:1788797093.888918:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797093.888940:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3879a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788797093.889021:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690176 00000100:00100000:2.0:1788797093.889031:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690176 00000100:00100000:2.0:1788797093.889075:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690304 00000100:00100000:2.0:1788797093.889077:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690304 00000100:00100000:2.0:1788797093.889089:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797093.889098:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984690176:12345-0@lo:104: 00010000:00010000:2.0:1788797093.889124:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.889203:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797093.889209:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:22804:x1875688984690176:12345-0@lo:104: Request processed in 112us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.889216:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797093.889233:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797093.889239:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984690304:12345-0@lo:104: 00010000:00010000:2.0:1788797093.889246:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797093.889274:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797093.889278:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:22804:x1875688984690304:12345-0@lo:104: Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.889283:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788797093.889489:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797093.889496:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889503:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4600 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797093.889507:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889522:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797093.889529:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797093.889535:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797093.889574:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889581:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797093.889611:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889619:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4600/0x500835b7bd2664db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664e2 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889633:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797093.889636:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889641:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1000 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:3.0:1788797093.889644:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889649:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788797093.889656:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788797093.889667:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788797093.889704:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889720:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788797093.889736:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889743:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd2664cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd2664d4 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889755:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797093.889757:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797093.889759:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797093.889774:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797093.889782:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797093.889795:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984690432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797093.889830:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.889863:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690432 00000100:00100000:3.0:1788797093.889868:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690432 00010000:00010000:3.0:1788797093.889890:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 25 pid: 22779 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797093.889911:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797093.889922:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+25:3654:x1875688984690432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797093.889932:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797093.889936:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 25 pid: 22779 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889955:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 25 pid: 22779 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.889969:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797093.889993:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943c4c9d-8ce2-4132-a4c5-0a007618de16+25:3654:x1875688984690432:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797093.889999:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788797093.890035:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984690432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797093.890055:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984690560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797093.890074:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797093.890102:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690560 00000100:00100000:3.0:1788797093.890105:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690560 00010000:00010000:3.0:1788797093.890118:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 25 pid: 22782 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797093.890135:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797093.890140:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+25:3656:x1875688984690560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797093.890147:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797093.890151:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 25 pid: 22782 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890160:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 25 pid: 22782 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890172:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890180:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788797093.890201:0:22773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011257707s 00010000:00010000:3.0:1788797093.890206:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890212:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890218:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890224:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890229:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797093.890233:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890241:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890249:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797093.890259:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797093.890284:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+25:3656:x1875688984690560:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797093.890291:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788797093.890312:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984690560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797093.890656:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:25111:x1875688984690048:12345-0@lo:253:mount.lustre.0 Request processed in 27758us (29290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797093.890664:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788797093.890872:0:25111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943c4c9d-8ce2-4132-a4c5-0a007618de16:25111:1875688984690048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788797093.890884:0:25111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788797093.890888:0:25111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788797093.890890:0:25111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788797093.890897:0:25111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788797093.890899:0:25111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788797093.890900:0:25111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788797093.890901:0:25111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788797093.890903:0:25111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788797093.890904:0:25111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788797093.890906:0:25111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788797093.890917:0:25111:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788797093.891625:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682ea00/0x500835b7bd2664e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2664db expref: 23 pid: 22779 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.891637:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984690176:0@lo:104: 00010000:00010000:1.0:1788797093.891647:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682e400/0x500835b7bd2664d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2664cd expref: 22 pid: 22782 timeout: 909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797093.891655:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22804:1875688984690304:0@lo:104: 00010000:00010000:1.0:1788797093.891677:0:22804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.891789:0:22804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.891796:0:22804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797093.891802:0:22804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb3881c4c00/0x500835b7bd266640 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788797093.898864:0:25111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788797093.902176:0:25111:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788797093.902185:0:25111:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788797093.902226:0:25111:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788797093.902268:0:25111:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788797093.902284:0:25111:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788797093.902303:0:25111:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788797093.906379:0:25111:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797093.906632:0:25111:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797094.039935:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788797094.915326:0:25178:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788797094.915830:0:25178:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788797095.061434:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797095.189069:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984690688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797095.189194:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797095.189259:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690688 00000100:00100000:0.0:1788797095.189267:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690688 00000100:00100000:0.0:1788797095.190538:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788797095.190551:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984690688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797095.190580:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797095.190640:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984690688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797095.190647:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788797095.190675:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797095.190767:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984690688:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788797095.258569:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788797095.258577:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb488901800 from 14 10000000:01000000:1.0:1788797095.258584:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788797095.258633:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.258644:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.258656:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797095.258728:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984690816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797095.258825:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797095.258862:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4be9853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797095.259469:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690816 00000100:00100000:0.0:1788797095.259479:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690816 00000100:00100000:0.0:1788797095.259536:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788797095.259545:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984690816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797095.259558:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797095.259572:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb491dd0c00/0x500835b7bd26664e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266647 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.259595:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb491dd0c00/0x500835b7bd26664e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266647 expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.259623:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb491dd0c00/0x500835b7bd26664e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266647 expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.259632:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd0c00, rc 0) 00000100:00100000:0.0:1788797095.259678:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984690816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797095.259708:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788797095.259770:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984690816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797095.259785:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26664e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.259794:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26664e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797095.259855:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984690944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788797095.259885:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797095.259907:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797095.260092:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984690944 00000100:00100000:1.0:1788797095.260098:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984690944 00000100:00100000:1.0:1788797095.260122:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788797095.260129:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984690944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797095.260147:0:22782:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797095.260161:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797095.260164:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788797095.260231:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984690944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797095.260238:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788797095.260360:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984690944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788797095.260489:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788797095.260496:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26664e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.260504:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4c00/0x500835b7bd266647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26664e expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797095.260513:0:22784:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788797095.260520:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fb4b9fd8800 from 14 10000000:01000000:0.0:1788797095.260523:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788797095.260540:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.260547:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.260556:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797095.260568:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984691072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797095.260591:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797095.260619:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788797095.260665:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691072 00000100:00100000:1.0:1788797095.260669:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691072 00000100:00100000:1.0:1788797095.260712:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788797095.260719:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984691072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797095.260727:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797095.260735:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb3881c4200/0x500835b7bd26665c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266655 expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.260762:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb3881c4200/0x500835b7bd26665c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266655 expref: 24 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.260769:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb3881c4200/0x500835b7bd26665c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266655 expref: 24 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.260775:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb3881c4200, rc 0) 00000100:00100000:1.0:1788797095.260812:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984691072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797095.260817:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788797095.261355:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984691072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797095.261369:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26665c expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797095.261931:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd26665c expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797095.262048:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984691200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788797095.262096:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797095.262173:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4be985d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797095.267953:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691200 00000100:00100000:0.0:1788797095.267967:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691200 00000100:00100000:1.0:1788797095.270719:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788797095.270774:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984691200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788797095.270815:0:22782:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788797095.270837:0:22782:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788797095.270840:0:22782:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788797095.270978:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984691200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 237us (8880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797095.270987:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788797095.272112:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984691200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788797095.272177:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788797095.272187:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26665c expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797095.272198:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd0000/0x500835b7bd266655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd26665c expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797096.088274:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797096.212352:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984691328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797096.212432:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797096.217139:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984691456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797096.217244:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797096.217314:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691328 00000100:00100000:0.0:1788797096.217322:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691328 00000100:00100000:0.0:1788797096.217398:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797096.217408:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984691328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797096.217458:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797096.217503:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984691328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (5071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797096.217509:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788797096.217589:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984691584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797096.217615:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797096.218327:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691456 00000100:00100000:0.0:1788797096.218336:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691456 00000100:00100000:0.0:1788797096.218375:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691584 00000100:00100000:0.0:1788797096.218378:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691584 00000100:00100000:0.0:1788797096.218394:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797096.218403:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984691456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797096.218433:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797096.218483:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984691456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797096.218490:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788797096.218505:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788797096.218510:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984691584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797096.218526:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797096.218553:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984691584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797096.218558:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788797096.218575:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797096.218833:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984691328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797096.222247:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984691584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797096.222369:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984691456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788797097.109490:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797097.301586:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788797098.137882:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.161504:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788797099.285202:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797099.285209:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797099.285213:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797099.285234:0:505:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fb385a68800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797099.285261:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3877ff480 x1875688984692096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788797099.285299:0:505:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788797099.285308:0:505:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788797099.285311:0:505:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788797099.285330:0:505:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fb3883fc800 using connection 192.168.201.127@tcp/0@lo 00000100:00100000:1.0:1788797099.285343:0:505:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fb3877fc380 x1875688984692608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788797099.288055:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984691840:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288134:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.288190:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984692480:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288257:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.288280:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984693120:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288313:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.288340:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788797099.288347:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984691968:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288370:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.288395:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984692736:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288769:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.288788:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1875688984693248:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.288811:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797099.288998:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691840 00000100:00100000:1.0:1788797099.289007:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691840 00000100:00100000:1.0:1788797099.289054:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788797099.289062:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984691840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.289117:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984691840:12345-0@lo:400:kworker.0 Request processed in 57us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.289125:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788797099.289164:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984691840:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289494:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692480 00000100:00100000:2.0:1788797099.289500:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692480 00000100:00100000:2.0:1788797099.289546:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691968 00000100:00100000:2.0:1788797099.289549:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691968 00000100:00100000:2.0:1788797099.289567:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797099.289573:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984692480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289609:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984692480:12345-0@lo:400:kworker.0 Request processed in 36us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.289614:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788797099.289626:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797099.289631:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984691968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289651:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984691968:12345-0@lo:400:kworker.0 Request processed in 21us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.289657:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788797099.289703:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693120 00000100:00100000:2.0:1788797099.289707:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693120 00000100:00100000:2.0:1788797099.289730:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692736 00000100:00100000:2.0:1788797099.289732:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692736 00000100:00100000:2.0:1788797099.289746:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693248 00000100:00100000:2.0:1788797099.289749:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693248 00000100:00100000:2.0:1788797099.289765:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797099.289771:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984693120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289799:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984693120:12345-0@lo:400:kworker.0 Request processed in 29us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.289817:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788797099.289829:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797099.289834:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984692736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289863:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984692736:12345-0@lo:400:kworker.0 Request processed in 29us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.289868:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788797099.289878:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788797099.289884:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875688984693248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.289907:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875688984693248:12345-0@lo:400:kworker.0 Request processed in 23us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.289911:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788797099.290051:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984691968:0@lo:400:kworker.0 00010000:00080000:1.0:1788797099.290065:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fc000 x1875688984692736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797099.290074:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984692736:0@lo:400:kworker.0 00010000:00080000:1.0:1788797099.290089:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877ff800 x1875688984693248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797099.290097:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1875688984693248:0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.290107:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984692480:0@lo:400:kworker.0 00010000:00080000:1.0:1788797099.290119:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877ff100 x1875688984693120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797099.290126:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984693120:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290530:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984692096:0@lo:8:kworker.0 00000100:00100000:2.0:1788797099.290566:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290599:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984692608:0@lo:8:kworker.0 00000100:00100000:2.0:1788797099.290620:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290654:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984692224:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290709:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290727:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984692864:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290746:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290767:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788797099.290773:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984691712:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290799:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290823:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984692352:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290847:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290877:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984692992:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.290900:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797099.290923:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692096 00000100:00100000:2.0:1788797099.290928:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692096 00000100:00100000:2.0:1788797099.290949:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692608 00000100:00100000:2.0:1788797099.290951:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692608 00000100:00100000:2.0:1788797099.290966:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788797099.290971:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3653:x1875688984692096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788797099.290998:0:24295:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 815 last 0 00000020:00000080:2.0:1788797099.291030:0:24295:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x500835b7bd266663 00002000:00100000:2.0:1788797099.291044:0:24295:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fb4bab2c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788797099.291048:0:24295:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788797099.291051:0:24295:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788797099.291234:0:24295:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788797099.291259:0:24295:0:(import.c:65:import_set_state_nolock()) ffff8fb497145000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797099.291477:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788797099.291484:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3653:x1875688984692608:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788797099.291502:0:24595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 815 last 0 00000020:00000080:3.0:1788797099.291518:0:24595:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x500835b7bd26666a 00002000:00100000:3.0:1788797099.291524:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8fb4844c1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788797099.291528:0:24595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788797099.291529:0:24595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788797099.291553:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788797099.291565:0:24595:0:(import.c:65:import_set_state_nolock()) ffff8fb4844c4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797099.291602:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875688984692608:12345-0@lo:8:kworker.0 Request processed in 118us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797099.291609:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788797099.291725:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692224 00000100:00100000:1.0:1788797099.291736:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692224 00000100:00100000:1.0:1788797099.291758:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692864 00000100:00100000:1.0:1788797099.291761:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692864 00000100:00100000:1.0:1788797099.291774:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692992 00000100:00100000:1.0:1788797099.291777:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692992 00000100:00100000:1.0:1788797099.291793:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788797099.291799:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984692224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.291843:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875688984692224:12345-0@lo:400:kworker.0 Request processed in 44us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.291849:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788797099.291862:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788797099.291868:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984692864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.291892:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875688984692864:12345-0@lo:400:kworker.0 Request processed in 25us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.291897:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788797099.291908:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788797099.291913:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984692992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.291937:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984692992:12345-0@lo:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.291943:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788797099.291962:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984691712 00000100:00100000:1.0:1788797099.291965:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984691712 00000100:00100000:1.0:1788797099.291989:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788797099.291995:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3656:x1875688984691712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.292024:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3656:x1875688984691712:12345-0@lo:400:kworker.0 Request processed in 30us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.292030:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788797099.292065:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984692352 00000100:00100000:1.0:1788797099.292069:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984692352 00000100:00100000:1.0:1788797099.292091:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797099.292097:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984692352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797099.292127:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984692352:12345-0@lo:400:kworker.0 Request processed in 30us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797099.292132:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788797099.292477:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943c4c9d-8ce2-4132-a4c5-0a007618de16:3656:1875688984691712:0@lo:400:kworker.0 00000100:00100000:3.0:1788797099.292495:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984692352:0@lo:400:kworker.0 00010000:00080000:3.0:1788797099.292507:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fce00 x1875688984692992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797099.292517:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984692992:0@lo:400:kworker.0 00010000:00080000:3.0:1788797099.292527:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fe300 x1875688984692224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797099.292535:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875688984692224:0@lo:400:kworker.0 00010000:00080000:3.0:1788797099.292545:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fc700 x1875688984692864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797099.292553:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3656:1875688984692864:0@lo:400:kworker.0 00000100:00100000:2.0:1788797099.292621:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1875688984692096:12345-0@lo:8:kworker.0 Request processed in 330us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.292628:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788797099.292736:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788797099.292742:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797099.292744:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788797099.293377:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877ff480 x1875688984692096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797099.293394:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788797099.293402:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788797099.293705:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788797099.293710:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb385a68800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788797099.293728:0:3653:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788797099.293734:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3653:1875688984692096:0@lo:8:kworker.0 00010000:00080000:2.0:1788797099.293753:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fc380 x1875688984692608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788797124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788797099.293772:0:3653:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788797099.293778:0:3653:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788797099.293781:0:3653:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788797099.293783:0:3653:0:(import.c:65:import_set_state_nolock()) ffff8fb3883fc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788797099.293799:0:3653:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788797099.293803:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3653:1875688984692608:0@lo:8:kworker.0 00000004:00080000:2.0:1788797099.293828:0:22814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788797099.293915:0:22814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815081233188ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788797099.293922:0:22814:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788797099.293942:0:23531:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788797099.293980:0:23531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 815081297721ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788797099.293984:0:23531:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788797099.295529:0:23532:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788797099.295564:0:23532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984693504:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788797099.295624:0:23532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797099.295653:0:23532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3883d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797099.295829:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984693376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797099.295857:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797099.295897:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693504 00000100:00100000:0.0:1788797099.295904:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693504 00000100:00100000:0.0:1788797099.295953:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788797099.295963:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23532:x1875688984693504:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788797099.296178:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693376 00000100:00100000:0.0:1788797099.296183:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693376 00000100:00100000:0.0:1788797099.296209:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788797099.296216:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875688984693376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788797099.296232:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788797099.296279:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875688984693376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797099.296287:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788797099.296317:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788797099.296348:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bfa74000 x1875688984693376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797099.296364:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984693376:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788797099.299176:0:22767:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788797099.299644:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984693632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797099.299733:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797099.299859:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693632 00000100:00100000:0.0:1788797099.299867:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693632 00000100:00100000:0.0:1788797099.299917:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788797099.299934:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984693632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797099.299958:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788797099.299999:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984693632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797099.300006:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788797099.300061:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788797099.300091:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bab27480 x1875688984693632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788797115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797099.300112:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984693632:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788797099.301217:0:22815:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788797099.301262:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875688984693760:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788797099.301324:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.301348:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd61ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788797099.303497:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693760 00000100:00100000:3.0:1788797099.303510:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693760 00000100:00100000:3.0:1788797099.303578:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788797099.303597:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22815:x1875688984693760:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788797099.305502:0:23521:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788797099.312283:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788797099.312291:0:24595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788797099.312399:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23532:x1875688984693504:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16433us (16769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797099.312419:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00002000:00080000:2.0:1788797099.313353:0:24294:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788797099.313362:0:24294:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1788797099.313368:0:24294:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00010000:00080000:0.0:1788797099.314535:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bfa76a00 x1875688984693504/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788797115 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797099.314555:0:23532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984693504:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788797099.314572:0:23532:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788797099.314622:0:23532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984693888:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788797099.314706:0:23532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797099.314737:0:23532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3883d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797099.314756:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984693888 00000100:00100000:0.0:1788797099.314762:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984693888 00000100:00100000:0.0:1788797099.314805:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797099.314815:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23532:x1875688984693888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788797099.314839:0:24295:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788797099.314872:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23532:x1875688984693888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797099.314879:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788797099.314909:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bfa76a00 x1875688984693888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788797115 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797099.314926:0:23532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984693888:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788797099.314934:0:23532:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788797099.314955:0:23532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984694016:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788797099.314976:0:23532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797099.314991:0:23532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3883d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788797099.315003:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694016 00000100:00100000:0.0:1788797099.315007:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694016 00000100:00100000:0.0:1788797099.315026:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788797099.315032:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23532:x1875688984694016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788797099.315056:0:24595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1788797099.331631:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.331646:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331662:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.331698:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.331705:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331723:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331734:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331742:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331760:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797099.331772:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797099.331778:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331785:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797099.331789:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331798:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331813:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331833:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd266671 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.331850:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.331852:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.331854:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.332247:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.332254:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.332263:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.332267:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.332271:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.332281:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.332288:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.332295:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.333861:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797099.335593:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.335608:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.335623:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.335628:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.335634:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.335646:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.335655:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.335662:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.335704:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788797099.335895:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788797099.335903:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335911:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797099.335916:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335924:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335943:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335951:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd266678 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335968:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797099.335971:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335987:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797099.335989:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.335995:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.336004:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.336010:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd26667f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797099.336021:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797099.336022:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797099.336024:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797099.336030:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.339354:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.339366:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.339383:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.339388:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.339395:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.341600:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.341620:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.341638:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.341665:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797099.342520:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.342529:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.342539:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.342544:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.342553:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.342574:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.342582:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd266686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.342604:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.342606:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.342608:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.345255:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.345268:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.345285:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.345289:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.345295:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.345310:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.345320:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.345327:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.345350:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797099.346528:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797099.346538:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.346547:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797099.346552:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.346562:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.346594:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.346601:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26668d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.346625:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.346627:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.346629:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.349920:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.349934:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.349960:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.349965:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.349971:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.349986:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.349998:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.350005:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.350028:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797099.350277:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.350284:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.350293:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.350307:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.350323:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.350338:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.350345:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266694 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.350364:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.350366:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.350368:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.351768:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.351781:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351793:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.351797:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.351802:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351812:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351836:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351843:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351869:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.351885:0:24734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.351890:0:24734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351898:0:24734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.351902:0:24734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351911:0:24734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351924:0:24734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351930:0:24734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26669b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.351945:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.351952:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.351954:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.355440:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.355456:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.355475:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.355479:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.355485:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.355499:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.355509:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.355517:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.355546:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797099.363847:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797099.363862:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.363877:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0a00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797099.363882:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.363894:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.363917:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.363925:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd2666a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.363977:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.363979:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.363981:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.365558:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.365570:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.365584:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.365589:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.365595:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.365620:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.365631:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.365638:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.365656:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797099.366103:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.366108:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366116:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.366119:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.366123:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366132:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366140:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366158:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366173:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797099.366263:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797099.366270:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366278:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.366281:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366290:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366311:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366319:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd2666a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366336:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.366338:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366354:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.366357:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366364:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366374:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366379:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.366391:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.366392:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.366393:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.366399:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.381589:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.381603:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.381620:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.381625:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.381632:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.381647:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.381658:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.381678:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.381726:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788797099.383654:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.383665:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.383729:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.383734:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.383740:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.383753:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.383764:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.383771:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.383792:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797099.384005:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797099.384013:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384021:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.384025:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384034:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384051:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384070:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c16b73/0x500835b7bd2666b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384090:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.384094:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384100:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29d000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.384103:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384110:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384119:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384127:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000220785fb/0x500835b7bd2666be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.384150:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.384151:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.384153:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.385613:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.386555:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.386566:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.386580:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.386585:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.386591:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.386604:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.386624:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.386631:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.386648:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797099.389091:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.389102:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.389124:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.389129:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.389136:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.389148:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.389158:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.389167:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.389182:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797099.390641:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797099.390652:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390662:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.390678:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390720:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390740:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390748:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d590ae10/0x500835b7bd2666c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390767:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.390771:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390778:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.390781:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390788:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390798:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390805:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d77213/0x500835b7bd2666cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.390829:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.390832:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.390833:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.390840:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797099.392632:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.392645:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.392660:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.392664:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.392696:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.392711:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.392733:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.392742:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.392763:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797099.393540:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797099.393548:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393558:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797099.393562:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393572:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393589:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393596:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ada4e20/0x500835b7bd2666d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393618:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.393627:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.393629:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.393932:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.393938:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393947:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.393951:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.393956:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393966:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393975:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.393983:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394006:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.394285:0:24734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.394292:0:24734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.394300:0:24734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29c600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.394304:0:24734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.394312:0:24734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.394324:0:24734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.394331:0:24734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f13d44e5/0x500835b7bd2666da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.394347:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.394349:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.394351:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.394525:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.394531:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394540:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.394543:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.394547:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394564:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394572:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394580:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.394598:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797099.394771:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.394777:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.394785:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29d600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.394789:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.394796:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.394807:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.394814:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1846a41/0x500835b7bd2666e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.394828:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.394836:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.394837:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.397701:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.397712:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.397729:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.397733:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.397740:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.397754:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.397764:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.397783:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.397808:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.398057:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.398066:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398080:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.398084:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398093:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398108:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398115:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5bb18e3/0x500835b7bd2666e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398133:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.398136:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.398138:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.398904:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.398911:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398920:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.398924:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.398927:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398938:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398953:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398959:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.398975:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788797099.399211:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797099.399217:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.399224:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797099.399228:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.399235:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.399246:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.399253:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023eb013b/0x500835b7bd2666ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.399265:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.399267:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797099.399268:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.408361:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.408387:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.408417:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.408423:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.408431:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.408447:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.408457:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.408465:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.408491:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.410772:0:24734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.410783:0:24734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.410795:0:24734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.410800:0:24734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.410811:0:24734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.410832:0:24734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.410839:0:24734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9252e1e/0x500835b7bd2666f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.410861:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.410870:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.410871:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.416137:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.416155:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.416173:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.416184:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.416191:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.416205:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.416223:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.416232:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.416337:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788797099.417270:0:25112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788797099.417309:0:25112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788797099.417320:0:25112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788797099.425245:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.425259:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.425273:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.425278:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.425289:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.425310:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.425318:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c3a7cce/0x500835b7bd2666fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.425345:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.425347:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.425349:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797099.425506:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23532:x1875688984694016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 110470us (110524us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788797099.425516:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797099.425575:0:23532:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788797099.425582:0:23532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23532:1875688984694016:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788797099.425608:0:23532:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788797099.425700:0:23532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab25180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875688984694144:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788797099.425737:0:23532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.425760:0:23532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788797099.425783:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694144 00000100:00100000:3.0:1788797099.425789:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694144 00000100:00100000:3.0:1788797099.425825:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788797099.425834:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875688984694144:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788797099.425877:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23532:x1875688984694144:12345-0@lo:900:osp-pre-1-1.0 Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797099.425884:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788797099.425915:0:23532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bab25180 x1875688984694144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788797115 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797099.425926:0:23532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab25180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23532:1875688984694144:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788797099.426289:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.426298:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.426310:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.426315:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.426329:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.426343:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.426353:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.426361:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.426376:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.426727:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.426734:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.426742:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7400 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.426746:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.426768:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.426782:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.426791:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3498e8f/0x500835b7bd266704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.426826:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.426828:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.426830:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788797099.427590:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788797099.427599:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.427610:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788797099.427614:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797099.427619:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.427630:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.427638:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.427657:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797099.427704:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797099.427935:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.427942:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.427950:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.427954:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.427962:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.427988:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.427996:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5026c13/0x500835b7bd26670b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.428011:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.428013:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.428015:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797099.431829:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.431844:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431863:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.431867:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.431874:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431889:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431900:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431907:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431938:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788797099.431950:0:24734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.431955:0:24734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431962:0:24734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683600 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.431966:0:24734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431974:0:24734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431990:0:24734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.431998:0:24734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f670d5a/0x500835b7bd266712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432014:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.432016:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.432017:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797099.432789:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.432796:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432807:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.432816:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.432822:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432833:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432841:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432848:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.432865:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788797099.433549:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.433556:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.433564:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.433568:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.433577:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.433592:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.433609:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007320585c/0x500835b7bd266719 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.433625:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.433627:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.433628:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788797099.435742:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.435755:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.435770:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.435775:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.435781:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.435794:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.435805:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.435822:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.435853:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788797099.437525:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788797099.437536:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437549:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788797099.437552:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797099.437557:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437569:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437577:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437583:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437599:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788797099.437610:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788797099.437615:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437629:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.437633:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437642:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437658:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437665:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075bb6170/0x500835b7bd266720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437707:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788797099.437711:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437717:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797099.437720:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437728:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437737:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437749:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007301aded/0x500835b7bd266727 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797099.437762:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.437763:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788797099.437765:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797099.438308:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.453715:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.453728:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.453745:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.453750:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.453756:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.453769:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.453779:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.453787:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.453808:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797099.454369:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.454378:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454388:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.454391:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.454395:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454497:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454506:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454514:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454528:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788797099.454537:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797099.454543:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454551:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.454557:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454566:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454586:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454595:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d13d5f/0x500835b7bd26672e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454612:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.454615:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454621:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0a00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.454624:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454632:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454640:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454646:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000195c4ac5/0x500835b7bd266735 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.454656:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.454658:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.454663:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797099.455742:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788797099.457819:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.457833:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.457850:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.457855:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.457861:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.457876:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.457887:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.457894:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.457917:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788797099.458391:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.458397:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.458646:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.458650:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.458655:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.458705:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.458714:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.458721:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.458738:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788797099.459009:0:24294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788797099.459015:0:24294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459024:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788797099.459027:0:24294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797099.459031:0:24294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459040:0:24294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459049:0:24294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459067:0:24294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459080:0:24294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788797099.459091:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788797099.459096:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459103:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.459107:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459116:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459132:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459139:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef45b61/0x500835b7bd26673c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459155:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797099.459158:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459173:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1000 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.459176:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459184:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459193:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459200:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db2d5b6/0x500835b7bd266743 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459211:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797099.459214:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459220:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1800 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:0.0:1788797099.459223:0:22776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459230:0:22776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459238:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459249:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6b028f1/0x500835b7bd26674a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797099.459260:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.459262:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797099.459263:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788797099.460714:0:24294:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788797099.460810:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22815:x1875688984693760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 157212us (159481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797099.460820:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788797099.460999:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797099.461042:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875688984693760:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788797099.461057:0:22815:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788797099.461101:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875688984694272:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788797099.461134:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797099.461157:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788797099.461254:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694272 00000100:00100000:3.0:1788797099.461261:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694272 00000100:00100000:3.0:1788797099.461296:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797099.461318:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22815:x1875688984694272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788797099.461353:0:24293:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1788797099.461399:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797099.470549:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22815:x1875688984694272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9222us (9404us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788797099.470562:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788797099.470804:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22815:1875688984694272:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788797099.470821:0:22815:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1788797100.181209:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797100.310814:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984694400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797100.310885:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797100.310936:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694400 00000100:00100000:0.0:1788797100.310943:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694400 00000100:00100000:0.0:1788797100.310986:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797100.310995:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984694400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788797100.311021:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797100.311059:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984694400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797100.311066:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788797100.311114:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984694400:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788797100.642364:0:25469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg127-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788797101.206453:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797101.332746:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984694528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797101.332821:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797101.334179:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694528 00000100:00100000:1.0:1788797101.334190:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694528 00000100:00100000:0.0:1788797101.334839:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3880d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984694656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797101.334916:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797101.352157:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797101.352176:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984694784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797101.352255:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797101.352400:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694784 00000100:00100000:0.0:1788797101.352408:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694784 00000100:00100000:0.0:1788797101.352459:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788797101.352467:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984694784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788797101.352494:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788797101.352533:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984694784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797101.352539:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788797101.352562:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797101.352593:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984694784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788797101.353206:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694656 00000100:00100000:1.0:1788797101.353214:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694656 00000100:00100000:1.0:1788797101.353248:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797101.353256:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984694528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788797101.357149:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788797101.357420:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984694528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4162us (24596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797101.357431:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797101.357471:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797101.357484:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984694656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788797101.357502:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788797101.357542:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984694656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (22626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797101.357548:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797101.357606:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3880d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984694656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797101.359165:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984694528:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788797101.589709:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788797101.730621:0:25521:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797101.730922:0:25521:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788797102.232127:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788797102.832001:0:25571:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788797102.834072:0:25571:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788797103.229941:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.230016:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594496 00000100:00100000:3.0:1788797103.230027:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594496 00000100:00100000:3.0:1788797103.230095:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:3.0:1788797103.230103:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2407:x1875688963594496:12345-192.168.201.27@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788797103.230132:0:22782:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 268b5117-b5e2-4f6e-ae4a-1da250176944@192.168.201.27@tcp t0 exp 0000000000000000 cur 819 last 0 00000020:00000080:3.0:1788797103.230160:0:22782:0:(genops.c:1384:class_connect()) connect: client 268b5117-b5e2-4f6e-ae4a-1da250176944, cookie 0x500835b7bd266751 00000100:00080000:3.0:1788797103.230298:0:22782:0:(import.c:65:import_set_state_nolock()) ffff8fb385403800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797103.230368:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+5:2407:x1875688963594496:12345-192.168.201.27@tcp:250:mount.lustre.0 Request processed in 263us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.230375:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 117 00000100:00100000:2.0:1788797103.238832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.238987:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594624 00000100:00100000:3.0:1788797103.238999:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594624 00000100:00100000:3.0:1788797103.239060:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:3.0:1788797103.239071:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+5:18146:x1875688963594624:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788797103.239089:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797103.239107:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb497682800/0x500835b7bd266758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5dfb4 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.239137:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb497682800/0x500835b7bd266758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfb4 expref: 6 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.239149:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb497682800/0x500835b7bd266758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfb4 expref: 6 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.239158:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497682800, rc 0) 00000100:00100000:3.0:1788797103.239213:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+6:18146:x1875688963594624:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 143us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.239221:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 118 00000100:00100000:3.0:1788797103.246293:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797103.246427:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594752 00000100:00100000:2.0:1788797103.246437:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594752 00000100:00100000:2.0:1788797103.246495:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:2.0:1788797103.246506:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+6:18146:x1875688963594752:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788797103.246639:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+6:18146:x1875688963594752:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 134us (357us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788797103.246646:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 119 00000100:00100000:3.0:1788797103.252740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797103.253006:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963594880 00000100:00100000:2.0:1788797103.253017:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963594880 00000100:00100000:2.0:1788797103.253081:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 120 00000100:00100000:2.0:1788797103.253091:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+6:18146:x1875688963594880:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797103.253112:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797103.253131:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4c20e7400/0x500835b7bd26675f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5dfbb expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.253164:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4c20e7400/0x500835b7bd26675f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfbb expref: 7 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.253192:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4c20e7400/0x500835b7bd26675f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfbb expref: 7 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.253203:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4c20e7400, rc 0) 00000100:00100000:2.0:1788797103.253268:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+7:18146:x1875688963594880:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 178us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797103.253276:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 120 00010000:00010000:3.0:1788797103.253407:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797103.260219:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.264964:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595008 00000100:00100000:3.0:1788797103.264983:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595008 00000100:00100000:3.0:1788797103.265321:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:3.0:1788797103.265333:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+7:18146:x1875688963595008:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788797103.265515:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18146:x1875688963595008:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 184us (5306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.265523:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 121 00000100:00100000:3.0:1788797103.272370:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.275345:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595136 00000100:00100000:0.0:1788797103.275362:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595136 00000100:00100000:1.0:1788797103.278088:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:1.0:1788797103.278104:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18146:x1875688963595136:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788797103.278333:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18146:x1875688963595136:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 231us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797103.278341:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 122 00000100:00100000:3.0:1788797103.283775:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.284173:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595264 00000100:00100000:0.0:1788797103.284192:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595264 00000100:00100000:0.0:1788797103.284304:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:0.0:1788797103.284315:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595264:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797103.284500:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595264:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 187us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797103.284508:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 123 00000100:00100000:0.0:1788797103.324905:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.325073:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595392 00000100:00100000:3.0:1788797103.325088:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595392 00000100:00100000:3.0:1788797103.325402:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:3.0:1788797103.325415:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb46bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595392:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797103.325570:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb46bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595392:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 158us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.325578:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 124 00000100:00100000:0.0:1788797103.336993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.337201:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595520 00000100:00100000:3.0:1788797103.337211:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595520 00000100:00100000:3.0:1788797103.337271:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:3.0:1788797103.337280:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595520:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797103.337438:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18164:x1875688963595520:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 158us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.337446:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 125 00000100:00100000:0.0:1788797103.352545:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.355391:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595648 00000100:00100000:3.0:1788797103.355495:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595648 00000100:00100000:3.0:1788797103.355621:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:3.0:1788797103.355634:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+8:18146:x1875688963595648:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788797103.355653:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797103.355672:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb497683600/0x500835b7bd266766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5dfec expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.355719:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb497683600/0x500835b7bd266766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfec expref: 9 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.355731:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb497683600/0x500835b7bd266766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dfec expref: 9 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.355741:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683600, rc 0) 00000100:00100000:3.0:1788797103.355818:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+9:18146:x1875688963595648:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 186us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.355825:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 126 00000100:00100000:0.0:1788797103.366656:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.366817:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595776 00000100:00100000:3.0:1788797103.366828:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595776 00000100:00100000:3.0:1788797103.366884:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 127 00000100:00100000:3.0:1788797103.366895:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bb469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+9:18146:x1875688963595776:12345-192.168.201.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788797103.366995:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788797103.367021:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788797103.367025:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788797103.367029:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788797103.367032:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788797103.367034:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788797103.370790:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bb469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+9:18146:x1875688963595776:12345-192.168.201.27@tcp:256:mount.lustre.0 Request processed in 3886us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.370813:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 127 00000100:00100000:3.0:1788797103.376846:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797103.376966:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963595904 00000100:00100000:2.0:1788797103.376990:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963595904 00000100:00100000:2.0:1788797103.377041:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:2.0:1788797103.377053:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+9:18146:x1875688963595904:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788797103.377071:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797103.377091:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5dff3 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.377122:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 10 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.377135:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 10 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797103.377145:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4c20e7000, rc 0) 00000100:00100000:2.0:1788797103.377207:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18146:x1875688963595904:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 157us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797103.377213:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 128 00000100:00100000:3.0:1788797103.381090:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.381475:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596032 00000100:00100000:0.0:1788797103.381485:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596032 00000100:00100000:0.0:1788797103.381529:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 129 00000100:00100000:0.0:1788797103.381539:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18146:x1875688963596032:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788797103.381724:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18146:x1875688963596032:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 186us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797103.381733:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 129 00000100:00100000:3.0:1788797103.384196:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.387771:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596160 00000100:00100000:0.0:1788797103.387788:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596160 00000100:00100000:0.0:1788797103.387882:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:0.0:1788797103.387894:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18146:x1875688963596160:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788797103.388052:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18146:x1875688963596160:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 161us (3863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797103.388060:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 130 00000100:00100000:0.0:1788797103.402330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.404026:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596288 00000100:00100000:3.0:1788797103.404044:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596288 00000100:00100000:3.0:1788797103.405038:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 131 00000100:00100000:3.0:1788797103.405052:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18169:x1875688963596288:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797103.406580:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18169:x1875688963596288:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 1524us (4254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.406593:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 131 00000100:00100000:2.0:1788797103.413060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.413182:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596416 00000100:00100000:0.0:1788797103.413196:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596416 00000100:00100000:0.0:1788797103.413266:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 132 00000100:00100000:0.0:1788797103.413277:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18169:x1875688963596416:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797103.413558:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18169:x1875688963596416:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 283us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797103.413567:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 132 00000100:00100000:0.0:1788797103.422799:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.422960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.430496:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596544 00000100:00100000:1.0:1788797103.430513:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596544 00000100:00100000:3.0:1788797103.430807:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596800 00000100:00100000:3.0:1788797103.430814:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596800 00000100:00100000:1.0:1788797103.430889:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1788797103.430899:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2407:x1875688963596544:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788797103.430930:0:24941:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2e5596e1-adfd-4fce-a2cd-12fb575d153a@192.168.201.27@tcp t0 exp 0000000000000000 cur 819 last 0 00000020:00000080:1.0:1788797103.430995:0:24941:0:(genops.c:1384:class_connect()) connect: client 2e5596e1-adfd-4fce-a2cd-12fb575d153a, cookie 0x500835b7bd266774 00000004:00100000:1.0:1788797103.431020:0:24941:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788797103.431525:0:24941:0:(import.c:65:import_set_state_nolock()) ffff8fb3868eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797103.431623:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2407:x1875688963596544:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 723us (8834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797103.431631:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:1.0:1788797103.431657:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1788797103.431663:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2407:x1875688963596800:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788797103.431704:0:24941:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 2e5596e1-adfd-4fce-a2cd-12fb575d153a@192.168.201.27@tcp t0 exp 0000000000000000 cur 819 last 0 00000020:00000080:1.0:1788797103.431761:0:24941:0:(genops.c:1384:class_connect()) connect: client 2e5596e1-adfd-4fce-a2cd-12fb575d153a, cookie 0x500835b7bd26677b 00000004:00100000:1.0:1788797103.431777:0:24941:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788797103.431956:0:24941:0:(import.c:65:import_set_state_nolock()) ffff8fb3868ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797103.431982:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2407:x1875688963596800:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 319us (9023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797103.431989:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1788797103.445562:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.445622:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.445672:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596672 00000100:00100000:3.0:1788797103.445673:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963596928 00000100:00100000:3.0:1788797103.445699:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596928 00000100:00100000:1.0:1788797103.445702:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963596672 00000100:00100000:1.0:1788797103.445771:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1788797103.445781:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:0:x1875688963596672:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788797103.445820:0:22789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788797103.445905:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:0:x1875688963596672:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 124us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797103.445912:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:3.0:1788797103.446744:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1788797103.446756:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:0:x1875688963596928:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788797103.446784:0:24940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797103.446844:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:0:x1875688963596928:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 91us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.446852:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1788797103.447766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.447793:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597056 00000100:00100000:3.0:1788797103.447800:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597056 00000100:00100000:3.0:1788797103.447834:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:3.0:1788797103.447842:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597056:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788797103.447867:0:24941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797103.447911:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597056:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.447917:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00080000:1.0:1788797103.450767:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788797103.450777:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797103.455621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.455663:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597184 00000100:00100000:3.0:1788797103.455672:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597184 00000100:00100000:3.0:1788797103.455748:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:3.0:1788797103.455758:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597184:12345-192.168.201.27@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788797103.455842:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597184:12345-192.168.201.27@tcp:40:mount.lustre.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.455850:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 12 00000100:00100000:1.0:1788797103.467909:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.467951:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.467995:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797103.468037:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597568 00000100:00100000:1.0:1788797103.468046:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597568 00000100:00100000:1.0:1788797103.468137:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:1.0:1788797103.468148:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597568:12345-192.168.201.27@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788797103.468552:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597312 00000100:00100000:2.0:1788797103.468558:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597312 00000100:00100000:2.0:1788797103.468584:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597440 00000100:00100000:2.0:1788797103.468587:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597440 00000100:00100000:2.0:1788797103.468619:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:2.0:1788797103.468625:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875688963597312:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788797103.468651:0:24595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2e5596e1-adfd-4fce-a2cd-12fb575d153a@192.168.201.27@tcp t0 exp 0000000000000000 cur 819 last 0 00000020:00000080:2.0:1788797103.468704:0:24595:0:(genops.c:1384:class_connect()) connect: client 2e5596e1-adfd-4fce-a2cd-12fb575d153a, cookie 0x500835b7bd266782 00002000:00100000:2.0:1788797103.468714:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e5596e1-adfd-4fce-a2cd-12fb575d153a/ffff8fb385426000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788797103.468731:0:24595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788797103.468905:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788797103.468932:0:24595:0:(import.c:65:import_set_state_nolock()) ffff8fb385427000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797103.469002:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2407:x1875688963597312:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 375us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797103.469011:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:2.0:1788797103.469028:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:2.0:1788797103.469032:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2407:x1875688963597440:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788797103.469047:0:24595:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2e5596e1-adfd-4fce-a2cd-12fb575d153a@192.168.201.27@tcp t0 exp 0000000000000000 cur 819 last 0 00000020:00000080:2.0:1788797103.469064:0:24595:0:(genops.c:1384:class_connect()) connect: client 2e5596e1-adfd-4fce-a2cd-12fb575d153a, cookie 0x500835b7bd266789 00002000:00100000:2.0:1788797103.469069:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e5596e1-adfd-4fce-a2cd-12fb575d153a/ffff8fb385420000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788797103.469080:0:24595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788797103.469177:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788797103.470513:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597568:12345-192.168.201.27@tcp:900:mount.lustre.0 Request processed in 2361us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797103.470525:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00080000:2.0:1788797103.471534:0:24595:0:(import.c:65:import_set_state_nolock()) ffff8fb385425000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788797103.471614:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2407:x1875688963597440:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 2577us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797103.471640:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:1.0:1788797103.488178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797103.489213:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597696 00000100:00100000:0.0:1788797103.490485:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597696 00000100:00100000:0.0:1788797103.490556:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:0.0:1788797103.490568:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597696:12345-192.168.201.27@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788797103.514844:0:22790:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24173us 00000004:00200000:0.0:1788797103.534378:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788797103.534524:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18146:x1875688963597696:12345-192.168.201.27@tcp:33:mount.lustre.0 Request processed in 43952us (46347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797103.534535:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:0.0:1788797103.781992:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797103.782120:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597824 00000100:00100000:3.0:1788797103.782132:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597824 00000100:00100000:3.0:1788797103.782208:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1788797103.782229:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18192:x1875688963597824:12345-192.168.201.27@tcp:101:mkdir.0 00010000:00010000:3.0:1788797103.782250:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797103.782277:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683a00/0x500835b7bd266790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e024 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782344:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782358:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782372:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797103.782432:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788797103.782436:0:24941:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788797103.782475:0:24941:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782503:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683a00/0x500835b7bd266790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e024 expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782522:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e024 expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797103.782528:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:3.0:1788797103.782531:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797103.782533:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683c00, rc 0) 00000100:00100000:3.0:1788797103.782842:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18192:x1875688963597824:12345-192.168.201.27@tcp:101:mkdir.0 Request processed in 623us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797103.782847:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00010000:00010000:1.0:1788797104.275980:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797104.404080:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788797104.404141:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797104.404204:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984695680:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.404372:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695168 00000100:00100000:2.0:1788797104.404379:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695168 00000100:00100000:2.0:1788797104.404454:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788797104.404464:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984695168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.404564:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984695040:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.404623:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984694912:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.407404:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984695168:12345-0@lo:400:kworker.0 Request processed in 2921us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.407419:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788797104.407465:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797104.407512:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984695296:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.407551:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797104.407620:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984695808:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.407644:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797104.407662:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984696320:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.407706:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797104.407735:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797104.407741:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984696704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797104.407815:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797104.407843:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695296 00000100:00100000:2.0:1788797104.407850:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695296 00000100:00100000:2.0:1788797104.407890:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695808 00000100:00100000:2.0:1788797104.407893:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695808 00000100:00100000:2.0:1788797104.407913:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797104.407921:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984695296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.407970:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3657:x1875688984695296:12345-0@lo:400:kworker.0 Request processed in 51us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.407993:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788797104.408004:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797104.408009:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984695808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.408033:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984695808:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.408038:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788797104.408050:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788797104.408075:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984695296:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.408084:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984695808:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.408118:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696320 00000100:00100000:2.0:1788797104.408122:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696320 00000100:00100000:2.0:1788797104.408171:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788797104.408178:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875688984696320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.408221:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875688984696320:12345-0@lo:400:kworker.0 Request processed in 37us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.408228:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788797104.408246:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797104.408263:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984696320:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.408301:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696704 00000100:00100000:2.0:1788797104.408304:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696704 00000100:00100000:2.0:1788797104.408326:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797104.408333:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984696704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788797104.408347:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788797104.408381:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984696704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.408398:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797104.408427:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984696704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788797104.412483:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797104.412543:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984695552:0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.412574:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797104.412619:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695040 00000100:00100000:3.0:1788797104.412627:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695040 00000100:00100000:3.0:1788797104.412665:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695552 00000100:00100000:3.0:1788797104.412667:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695552 00000100:00100000:3.0:1788797104.412696:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788797104.412705:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984695040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.412779:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984695040:12345-0@lo:400:kworker.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797104.412787:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788797104.412808:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788797104.412813:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984695552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.412840:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984695552:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797104.412846:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788797104.412881:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984695552:0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.412889:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1875688984696064:0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.412912:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797104.412933:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696064 00000100:00100000:3.0:1788797104.412935:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696064 00000100:00100000:3.0:1788797104.412976:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788797104.412983:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875688984696064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.413012:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875688984696064:12345-0@lo:400:kworker.0 Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797104.413017:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788797104.413033:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797104.413052:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1875688984696064:0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.413059:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3880d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797104.413084:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797104.413106:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696576 00000100:00100000:3.0:1788797104.413111:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696576 00000100:00100000:3.0:1788797104.413134:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797104.413147:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984696576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797104.413163:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797104.413194:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875688984696576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797104.413199:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788797104.413244:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3880d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797104.413275:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984695040:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414458:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797104.414508:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984695424:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414539:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797104.414568:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984695936:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414601:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797104.414632:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695424 00000100:00100000:0.0:1788797104.414638:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695424 00000100:00100000:0.0:1788797104.414671:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695936 00000100:00100000:0.0:1788797104.414674:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695936 00000100:00100000:0.0:1788797104.414712:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788797104.414720:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984695424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414761:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875688984695424:12345-0@lo:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797104.414767:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788797104.414786:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788797104.414804:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984695936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414832:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875688984695936:12345-0@lo:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797104.414838:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788797104.414873:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875688984695936:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414880:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1875688984696448:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414900:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797104.414920:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696448 00000100:00100000:0.0:1788797104.414924:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696448 00000100:00100000:0.0:1788797104.414955:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788797104.414961:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875688984696448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.414991:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875688984696448:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797104.414996:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788797104.415014:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788797104.415034:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb38820e680 x1875688984696448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797104.415045:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3654:1875688984696448:0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.417326:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875688984695424:0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.417513:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984694912 00000100:00100000:3.0:1788797104.417522:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984694912 00000100:00100000:3.0:1788797104.417594:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788797104.417603:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3654:x1875688984694912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797104.417708:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3654:x1875688984694912:12345-0@lo:400:kworker.0 Request processed in 105us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797104.417716:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788797104.418321:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984694912:0@lo:400:kworker.0 00000100:00100000:1.0:1788797104.419355:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797104.419502:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984696192:0@lo:400:kworker.0 00000100:00100000:1.0:1788797104.419532:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797104.419626:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984695168:0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.422591:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984695680 00000100:00100000:2.0:1788797104.422606:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984695680 00000100:00100000:2.0:1788797104.422706:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797104.422717:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984695680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797104.422813:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984695680:12345-0@lo:400:kworker.0 Request processed in 98us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797104.422820:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788797104.422928:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984695680:0@lo:400:kworker.0 00000100:00080000:3.0:1788797104.423000:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797104.423481:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696192 00000100:00100000:0.0:1788797104.423487:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696192 00000100:00100000:0.0:1788797104.423589:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788797104.423598:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984696192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797104.423670:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875688984696192:12345-0@lo:400:kworker.0 Request processed in 73us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797104.423677:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788797104.424575:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb3877fdf80 x1875688984696192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797104.424614:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3656:1875688984696192:0@lo:400:kworker.0 00000100:00080000:3.0:1788797104.427460:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788797105.300202:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797105.427909:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984696832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797105.427987:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797105.428091:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696832 00000100:00100000:1.0:1788797105.428100:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696832 00000100:00100000:1.0:1788797105.428152:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797105.428161:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984696832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788797105.428191:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788797105.428908:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984696832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 744us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797105.428919:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788797105.429002:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984696832:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788797105.434903:0:25112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e5596e1-adfd-4fce-a2cd-12fb575d153a 00000001:00080000:2.0:1788797105.434920:0:25112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788797106.289439:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.289597:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963597952 00000100:00100000:0.0:1788797106.289610:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963597952 00000100:00100000:0.0:1788797106.289719:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:0.0:1788797106.289732:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18244:x1875688963597952:12345-192.168.201.27@tcp:41:lfs.0 00000004:00000024:0.0:1788797106.289769:0:22789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797106.289865:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18244:x1875688963597952:12345-192.168.201.27@tcp:41:lfs.0 Request processed in 135us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.289873:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00080000:3.0:1788797106.293746:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797106.294714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.300600:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598080 00000100:00100000:3.0:1788797106.300618:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598080 00000100:00100000:3.0:1788797106.300799:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1788797106.300811:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18244:x1875688963598080:12345-192.168.201.27@tcp:41:lfs.0 00000004:00000024:3.0:1788797106.300871:0:24941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797106.300976:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18244:x1875688963598080:12345-192.168.201.27@tcp:41:lfs.0 Request processed in 167us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.300983:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00080000:0.0:1788797106.301051:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788797106.315329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.315467:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598208 00000100:00100000:1.0:1788797106.315478:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598208 00000100:00100000:1.0:1788797106.315544:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:1.0:1788797106.315568:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18244:x1875688963598208:12345-192.168.201.27@tcp:13:lfs.0 00002000:00000024:1.0:1788797106.315605:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788797106.315719:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18244:x1875688963598208:12345-192.168.201.27@tcp:13:lfs.0 Request processed in 156us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.315727:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00080000:0.0:1788797106.315991:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797106.320183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.320280:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598336 00000100:00100000:1.0:1788797106.320292:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598336 00000100:00100000:1.0:1788797106.320365:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:1.0:1788797106.320378:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18244:x1875688963598336:12345-192.168.201.27@tcp:13:lfs.0 00002000:00000024:1.0:1788797106.320412:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797106.320527:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18244:x1875688963598336:12345-192.168.201.27@tcp:13:lfs.0 Request processed in 152us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.320544:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00080000:0.0:1788797106.320707:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788797106.324340:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797106.451960:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788797106.451986:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984696960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797106.452065:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797106.452193:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797106.452200:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984697088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797106.452227:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797106.452248:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697088 00000100:00100000:0.0:1788797106.452255:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697088 00000100:00100000:0.0:1788797106.452293:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797106.452299:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984697088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788797106.452325:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797106.452359:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984697088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.452363:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788797106.452401:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfa76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984697088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797106.452578:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984696960 00000100:00100000:1.0:1788797106.452584:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984696960 00000100:00100000:1.0:1788797106.452632:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788797106.452640:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984696960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797106.452656:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788797106.452726:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984696960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.452733:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788797106.452755:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984696960:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788797106.452811:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797106.457594:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788797106.457618:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3880d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984697216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788797106.457706:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797106.457836:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697216 00000100:00100000:0.0:1788797106.457846:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697216 00000100:00100000:0.0:1788797106.457908:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788797106.457918:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984697216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797106.457943:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797106.457994:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984697216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.458001:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788797106.458091:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3880d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984697216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797106.566021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.566194:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598464 00000100:00100000:0.0:1788797106.566206:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598464 00000100:00100000:0.0:1788797106.566438:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:0.0:1788797106.566451:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+10:18275:x1875688963598464:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788797106.566480:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797106.566499:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb491dd0800/0x500835b7bd26679e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e02b expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.566532:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb491dd0800/0x500835b7bd26679e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e02b expref: 11 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.566556:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb491dd0800/0x500835b7bd26679e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e02b expref: 11 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.566566:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd0800, rc 0) 00000100:00100000:0.0:1788797106.566634:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bdc33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963598464:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 186us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.566641:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 134 00000100:00100000:2.0:1788797106.573204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.574119:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598592 00000100:00100000:0.0:1788797106.574133:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598592 00000100:00100000:0.0:1788797106.574250:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00100000:0.0:1788797106.574259:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963598592:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788797106.574405:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963598592:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 146us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.574413:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 135 00000100:00100000:2.0:1788797106.591948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.592342:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598720 00000100:00100000:0.0:1788797106.592353:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598720 00000100:00100000:0.0:1788797106.592399:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:0.0:1788797106.592409:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963598720:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788797106.592553:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963598720:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 134us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.592562:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 136 00000100:00100000:2.0:1788797106.623057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.623158:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598848 00000100:00100000:0.0:1788797106.623169:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598848 00000100:00100000:0.0:1788797106.623228:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:0.0:1788797106.623239:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963598848:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797106.623395:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963598848:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 157us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.623404:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 137 00000100:00100000:2.0:1788797106.719793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.720049:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963598976 00000100:00100000:3.0:1788797106.720060:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963598976 00000100:00100000:3.0:1788797106.720126:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 138 00000100:00100000:3.0:1788797106.720136:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963598976:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788797106.720731:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963598976:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 592us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.720740:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 138 00000100:00100000:2.0:1788797106.747251:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.747521:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599104 00000100:00100000:1.0:1788797106.747531:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599104 00000100:00100000:1.0:1788797106.747604:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 139 00000100:00100000:1.0:1788797106.747615:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963599104:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797106.747805:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18282:x1875688963599104:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 191us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.747814:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 139 00000100:00100000:2.0:1788797106.757445:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.757555:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599232 00000100:00100000:3.0:1788797106.757567:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599232 00000100:00100000:3.0:1788797106.757630:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 140 00000100:00100000:3.0:1788797106.757639:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18275:x1875688963599232:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788797106.757654:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797106.757712:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb497683a00/0x500835b7bd2667a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e05c expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797106.757741:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb497683a00/0x500835b7bd2667a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e05c expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797106.757752:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb497683a00/0x500835b7bd2667a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e05c expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797106.757761:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683a00, rc 0) 00000100:00100000:3.0:1788797106.757823:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18275:x1875688963599232:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 184us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.757830:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 140 00000100:00100000:2.0:1788797106.766055:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.766218:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599360 00000100:00100000:1.0:1788797106.766230:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599360 00000100:00100000:1.0:1788797106.766291:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:1.0:1788797106.766301:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18275:x1875688963599360:12345-192.168.201.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788797106.766332:0:22779:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788797106.766358:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788797106.766362:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788797106.766366:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788797106.766369:0:22779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788797106.766379:0:22779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788797106.768980:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18275:x1875688963599360:12345-192.168.201.27@tcp:256:mount.lustre.0 Request processed in 2667us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.768997:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 141 00000100:00100000:2.0:1788797106.776104:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.778947:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599488 00000100:00100000:0.0:1788797106.778965:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599488 00000100:00100000:0.0:1788797106.779039:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 142 00000100:00100000:0.0:1788797106.779050:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18275:x1875688963599488:12345-192.168.201.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788797106.779097:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797106.779119:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e063 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.779154:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.779165:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797106.779174:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1200, rc 0) 00000100:00100000:0.0:1788797106.779249:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18275:x1875688963599488:12345-192.168.201.27@tcp:101:mount.lustre.0 Request processed in 201us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.779257:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 142 00000100:00100000:2.0:1788797106.785750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.786599:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599616 00000100:00100000:1.0:1788797106.786612:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599616 00000100:00100000:1.0:1788797106.786676:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 143 00000100:00100000:1.0:1788797106.786711:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18275:x1875688963599616:12345-192.168.201.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788797106.786903:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18275:x1875688963599616:12345-192.168.201.27@tcp:501:mount.lustre.0 Request processed in 193us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.786912:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 143 00000100:00100000:2.0:1788797106.794341:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.794434:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599744 00000100:00100000:3.0:1788797106.794446:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599744 00000100:00100000:3.0:1788797106.794505:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 144 00000100:00100000:3.0:1788797106.794515:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18275:x1875688963599744:12345-192.168.201.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788797106.794658:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18275:x1875688963599744:12345-192.168.201.27@tcp:503:mount.lustre.0 Request processed in 143us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.794665:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 144 00000100:00100000:2.0:1788797106.801964:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.802135:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963599872 00000100:00100000:0.0:1788797106.802146:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963599872 00000100:00100000:0.0:1788797106.802217:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 145 00000100:00100000:0.0:1788797106.802228:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18286:x1875688963599872:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788797106.802378:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18286:x1875688963599872:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.802387:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 145 00000100:00100000:2.0:1788797106.811956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.812217:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600000 00000100:00100000:1.0:1788797106.812229:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600000 00000100:00100000:1.0:1788797106.812279:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00100000:1.0:1788797106.812290:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18286:x1875688963600000:12345-192.168.201.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788797106.812457:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18286:x1875688963600000:12345-192.168.201.27@tcp:502:llog_process_th.0 Request processed in 168us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.812465:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 146 00000100:00100000:2.0:1788797106.818198:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.818377:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600128 00000100:00100000:0.0:1788797106.818389:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600128 00000100:00100000:0.0:1788797106.818441:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1788797106.818450:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2407:x1875688963600128:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788797106.818491:0:24940:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6@192.168.201.27@tcp t0 exp 0000000000000000 cur 822 last 0 00000020:00000080:0.0:1788797106.818557:0:24940:0:(genops.c:1384:class_connect()) connect: client 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6, cookie 0x500835b7bd2667b3 00000004:00100000:0.0:1788797106.818585:0:24940:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788797106.818727:0:24940:0:(import.c:65:import_set_state_nolock()) ffff8fb3854ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788797106.818803:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2407:x1875688963600128:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 351us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.818811:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:2.0:1788797106.819896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797106.823628:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600384 00000100:00100000:1.0:1788797106.823646:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600384 00000100:00100000:1.0:1788797106.823729:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:1.0:1788797106.823737:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875688963600384:12345-192.168.201.27@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788797106.823771:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6@192.168.201.27@tcp t0 exp 0000000000000000 cur 822 last 0 00000020:00000080:1.0:1788797106.823807:0:22788:0:(genops.c:1384:class_connect()) connect: client 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6, cookie 0x500835b7bd2667ba 00000004:00100000:1.0:1788797106.824406:0:22788:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788797106.825416:0:22788:0:(import.c:65:import_set_state_nolock()) ffff8fb3868ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788797106.825884:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2407:x1875688963600384:12345-192.168.201.27@tcp:38:mount.lustre.0 Request processed in 2142us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.825896:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:2.0:1788797106.850807:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.851020:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600256 00000100:00100000:3.0:1788797106.851031:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600256 00000100:00080000:0.0:1788797106.851250:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797106.851418:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:3.0:1788797106.851432:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:0:x1875688963600256:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788797106.851464:0:24941:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788797106.851547:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:0:x1875688963600256:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 110us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.851573:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:2.0:1788797106.853999:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797106.854545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.862420:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600640 00000100:00100000:0.0:1788797106.862439:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600640 00000100:00100000:0.0:1788797106.862497:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600512 00000100:00100000:0.0:1788797106.862500:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600512 00000100:00100000:0.0:1788797106.862568:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:0.0:1788797106.862578:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963600640:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788797106.862610:0:22787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788797106.862699:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963600640:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 107us (8693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.862707:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:0.0:1788797106.862732:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1788797106.862739:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:0:x1875688963600512:12345-192.168.201.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788797106.862751:0:22787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797106.862778:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:0:x1875688963600512:12345-192.168.201.27@tcp:41:mount.lustre.0 Request processed in 39us (8244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.862784:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00080000:2.0:1788797106.863291:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788797106.886161:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.886353:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600768 00000100:00100000:0.0:1788797106.886363:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600768 00000100:00100000:0.0:1788797106.886497:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:0.0:1788797106.886523:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963600768:12345-192.168.201.27@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788797106.886642:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963600768:12345-192.168.201.27@tcp:40:mount.lustre.0 Request processed in 122us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797106.886650:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:2.0:1788797106.900012:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797106.900054:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797106.900091:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797106.900304:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963600896 00000100:00100000:3.0:1788797106.900314:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963600896 00000100:00100000:3.0:1788797106.900351:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601024 00000100:00100000:3.0:1788797106.900354:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601024 00000100:00100000:3.0:1788797106.900371:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:3.0:1788797106.900380:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1875688963600896:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788797106.900414:0:24293:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6@192.168.201.27@tcp t0 exp 0000000000000000 cur 822 last 0 00000020:00000080:3.0:1788797106.900445:0:24293:0:(genops.c:1384:class_connect()) connect: client 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6, cookie 0x500835b7bd2667c1 00002000:00100000:3.0:1788797106.900456:0:24293:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6/ffff8fb385407000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788797106.900467:0:24293:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788797106.900556:0:24293:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788797106.900585:0:24293:0:(import.c:65:import_set_state_nolock()) ffff8fb385400000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797106.900654:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2407:x1875688963600896:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 274us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.900662:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:3.0:1788797106.900704:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:3.0:1788797106.900709:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1875688963601024:12345-192.168.201.27@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788797106.900726:0:24293:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6@192.168.201.27@tcp t0 exp 0000000000000000 cur 822 last 0 00000020:00000080:3.0:1788797106.900742:0:24293:0:(genops.c:1384:class_connect()) connect: client 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6, cookie 0x500835b7bd2667c8 00002000:00100000:3.0:1788797106.900748:0:24293:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6/ffff8fb385405000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788797106.900754:0:24293:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788797106.900795:0:24293:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788797106.900809:0:24293:0:(import.c:65:import_set_state_nolock()) ffff8fb385401000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788797106.900863:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2407:x1875688963601024:12345-192.168.201.27@tcp:8:mount.lustre.0 Request processed in 152us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797106.900870:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:1.0:1788797106.902195:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601152 00000100:00100000:1.0:1788797106.902206:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601152 00000100:00100000:1.0:1788797106.902264:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:1.0:1788797106.902273:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963601152:12345-192.168.201.27@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788797106.902344:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963601152:12345-192.168.201.27@tcp:900:mount.lustre.0 Request processed in 71us (2342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797106.902351:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:2.0:1788797106.909412:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797106.909565:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601280 00000100:00100000:0.0:1788797106.909577:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601280 00000100:00100000:0.0:1788797106.909642:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1788797106.909654:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963601280:12345-192.168.201.27@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788797106.909812:0:22791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788797106.914390:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18275:x1875688963601280:12345-192.168.201.27@tcp:33:mount.lustre.0 Request processed in 4727us (4976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797106.914412:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:2.0:1788797107.318971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797107.319136:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601408 00000100:00100000:0.0:1788797107.319148:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601408 00000100:00100000:0.0:1788797107.319235:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:0.0:1788797107.319246:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18310:x1875688963601408:12345-192.168.201.27@tcp:101:mkdir.0 00010000:00010000:0.0:1788797107.319271:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797107.319299:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e094 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319375:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319390:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319405:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797107.319451:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797107.319454:0:24941:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797107.319488:0:24941:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319514:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319544:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797107.319554:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:0.0:1788797107.319558:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797107.319561:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1e00, rc 0) 00000100:00100000:0.0:1788797107.319622:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+7:18310:x1875688963601408:12345-192.168.201.27@tcp:101:mkdir.0 Request processed in 379us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797107.319629:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00010000:00010000:3.0:1788797107.348133:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788797107.540778:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788797108.371979:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788797109.024877:0:22767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6 00000001:00100000:3.0:1788797109.024892:0:22767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e5596e1-adfd-4fce-a2cd-12fb575d153a 00000001:00100000:3.0:1788797109.026323:0:23521:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6 00000001:00100000:3.0:1788797109.026335:0:23521:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e5596e1-adfd-4fce-a2cd-12fb575d153a 00000001:00100000:2.0:1788797109.027669:0:24289:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6 00000001:00100000:2.0:1788797109.027720:0:24289:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e5596e1-adfd-4fce-a2cd-12fb575d153a 00010000:00010000:0.0:1788797109.397944:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797109.526913:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797109.526939:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984697344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788797109.527020:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.527294:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697344 00000100:00100000:1.0:1788797109.527304:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697344 00000100:00100000:1.0:1788797109.527370:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797109.527382:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984697344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788797109.527417:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797109.527469:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984697344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.527477:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788797109.527538:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788797109.527561:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984697344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788797109.527795:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984697600:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.527831:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.527859:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984698112:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.527906:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.527924:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.527946:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.527964:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788797109.527969:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.527992:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.528010:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984697984:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528031:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.528045:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1875688984698496:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528065:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797109.528090:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697600 00000100:00100000:3.0:1788797109.528094:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697600 00000100:00100000:3.0:1788797109.528118:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697984 00000100:00100000:3.0:1788797109.528121:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697984 00000100:00100000:3.0:1788797109.528134:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797109.528148:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984697600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528190:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984697600:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528196:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797109.528212:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797109.528219:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984697984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528244:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984697984:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528249:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797109.528266:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698112 00000100:00100000:3.0:1788797109.528269:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698112 00000100:00100000:3.0:1788797109.528294:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797109.528300:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984698112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528328:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984698112:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528333:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797109.528350:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698624 00000100:00100000:3.0:1788797109.528353:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698624 00000100:00100000:3.0:1788797109.528376:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698496 00000100:00100000:3.0:1788797109.528379:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698496 00000100:00100000:3.0:1788797109.528398:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788797109.528404:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984698624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528432:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875688984698624:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528438:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788797109.528448:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788797109.528453:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875688984698496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528483:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875688984698496:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528503:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788797109.528522:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697472 00000100:00100000:3.0:1788797109.528525:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697472 00000100:00100000:3.0:1788797109.528545:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788797109.528551:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3655:x1875688984697472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528593:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3655:x1875688984697472:12345-0@lo:400:kworker.0 Request processed in 42us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797109.528600:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788797109.528636:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984697472:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528646:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984697984:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528654:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3655:1875688984698496:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528662:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984697600:0@lo:400:kworker.0 00000100:00100000:3.0:1788797109.528669:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984698112:0@lo:400:kworker.0 00010000:00080000:3.0:1788797109.528705:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb38813e680 x1875688984698624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788797109.528716:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3655:1875688984698624:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529143:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984697856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529177:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529210:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984698368:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529230:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529260:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984698880:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529280:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529298:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788797109.529304:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529324:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529339:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984698240:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529357:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529373:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984698752:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529393:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797109.529417:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697856 00000100:00100000:1.0:1788797109.529422:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697856 00000100:00100000:1.0:1788797109.529445:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698368 00000100:00100000:1.0:1788797109.529448:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698368 00000100:00100000:1.0:1788797109.529458:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698880 00000100:00100000:1.0:1788797109.529460:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698880 00000100:00100000:1.0:1788797109.529473:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698752 00000100:00100000:1.0:1788797109.529475:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698752 00000100:00100000:1.0:1788797109.529501:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788797109.529510:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984697856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529549:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984697856:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.529555:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788797109.529570:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797109.529576:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984698368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529601:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984698368:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.529606:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788797109.529626:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797109.529632:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984698880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529658:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984698880:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.529663:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788797109.529672:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797109.529676:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875688984698752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529742:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875688984698752:12345-0@lo:400:kworker.0 Request processed in 65us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.529747:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788797109.529769:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984697728 00000100:00100000:1.0:1788797109.529772:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984697728 00000100:00100000:1.0:1788797109.529912:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984698240 00000100:00100000:1.0:1788797109.529915:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984698240 00000100:00100000:1.0:1788797109.529929:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797109.529935:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984697728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.529963:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984697728:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.529968:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797109.529979:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797109.529984:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984698240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.530008:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984698240:12345-0@lo:400:kworker.0 Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.530013:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788797109.530056:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.530065:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984698240:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.530083:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3657:1875688984698752:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.530092:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984697856:0@lo:400:kworker.0 00000100:00100000:1.0:1788797109.530101:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984698368:0@lo:400:kworker.0 00010000:00080000:1.0:1788797109.530110:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb38813ca80 x1875688984698880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797109.530119:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984698880:0@lo:400:kworker.0 00000100:00100000:0.0:1788797109.530305:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797109.530315:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984699008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797109.530345:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788797109.530422:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788797109.530427:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788797109.530429:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788797109.530431:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797109.531572:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699008 00000100:00100000:1.0:1788797109.531582:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699008 00000100:00100000:1.0:1788797109.531638:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788797109.531648:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984699008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788797109.531669:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788797109.532078:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984699008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 431us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797109.532086:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797109.532176:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984699008:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788797110.419910:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797110.560952:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788797110.560987:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797110.561084:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797110.561263:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699136 00000100:00100000:2.0:1788797110.561277:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699136 00000100:00100000:2.0:1788797110.561371:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788797110.561383:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984699136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797110.561424:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788797110.561506:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984699136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797110.561515:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797110.561667:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984699136:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788797111.044753:0:25671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788797111.452155:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797111.573751:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984699264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788797111.573861:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797111.573930:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788797111.573938:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984699392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797111.573969:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797111.574083:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699264 00000100:00100000:3.0:1788797111.574096:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699264 00000100:00100000:0.0:1788797111.574098:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699392 00000100:00100000:0.0:1788797111.574112:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699392 00000100:00100000:0.0:1788797111.574179:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788797111.574194:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984699392:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797111.574198:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788797111.574216:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984699264:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:0.0:1788797111.574236:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00002000:00000024:3.0:1788797111.574240:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788797111.574308:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984699264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797111.574316:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788797111.574368:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984699392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797111.574395:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984699392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797111.574402:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797111.574423:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984699264:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788797111.574653:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797111.575561:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788797111.575795:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984699520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797111.575865:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797111.576635:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699520 00000100:00100000:3.0:1788797111.576653:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699520 00000100:00100000:3.0:1788797111.576760:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788797111.576773:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984699520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788797111.576825:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788797111.576931:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984699520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797111.576939:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788797111.577086:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984699520:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788797111.834014:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788797112.098101:0:25112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6 00000100:00100000:3.0:1788797112.131373:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131425:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131469:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131622:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797112.131707:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601920 00000100:00100000:3.0:1788797112.131721:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601920 00000100:00100000:3.0:1788797112.131797:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602432 00000100:00100000:3.0:1788797112.131800:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602432 00000100:00100000:3.0:1788797112.131816:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602048 00000100:00100000:3.0:1788797112.131819:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602048 00000100:00100000:3.0:1788797112.131837:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602560 00000100:00100000:3.0:1788797112.131840:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602560 00000100:00100000:3.0:1788797112.131861:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1788797112.131872:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963601920:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.131972:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963601920:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 101us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.131980:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:3.0:1788797112.132003:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1788797112.132010:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb485b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602432:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.132037:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb485b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602432:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.132044:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:3.0:1788797112.132252:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1788797112.132259:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963602048:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.132285:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963602048:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.132292:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:3.0:1788797112.132315:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1788797112.132321:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602560:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.132347:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602560:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.132354:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:3.0:1788797112.132379:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601664 00000100:00100000:3.0:1788797112.132384:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601664 00000100:00100000:3.0:1788797112.132424:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602176 00000100:00100000:3.0:1788797112.132428:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602176 00000100:00100000:3.0:1788797112.132459:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601792 00000100:00100000:3.0:1788797112.132463:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601792 00000100:00100000:3.0:1788797112.132480:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602304 00000100:00100000:3.0:1788797112.132482:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602304 00000100:00100000:3.0:1788797112.132499:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:3.0:1788797112.132506:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2409:x1875688963601664:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.132542:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2409:x1875688963601664:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 35us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797112.132554:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:0.0:1788797112.132660:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2409:x1875688963602176:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788797112.132781:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2409:x1875688963602176:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 136us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.135628:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:3.0:1788797112.135713:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1788797112.135738:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963601792:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.135914:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963601792:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 121us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.135925:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1788797112.136001:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:3.0:1788797112.136012:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602304:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.136115:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963602304:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 105us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.136141:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:3.0:1788797112.136281:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963601536 00000100:00100000:3.0:1788797112.136293:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963601536 00000100:00100000:3.0:1788797112.136348:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 148 00000100:00100000:3.0:1788797112.136356:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2409:x1875688963601536:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797112.136383:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2409:x1875688963601536:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 28us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797112.136390:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 148 00000100:00080000:3.0:1788797112.136467:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788797112.136475:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788797112.136482:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797112.136486:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788797112.148499:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00010000:00010000:1.0:1788797112.473168:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797113.497723:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797114.526511:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797114.644446:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984699648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788797114.644565:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.645022:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788797114.645036:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984699776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797114.645226:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797114.645472:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699648 00000100:00100000:3.0:1788797114.645484:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699648 00000100:00100000:3.0:1788797114.645545:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699776 00000100:00100000:3.0:1788797114.645549:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699776 00000100:00100000:3.0:1788797114.645573:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788797114.645584:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984699648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788797114.645623:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797114.645704:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984699648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.645712:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788797114.645734:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788797114.645741:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984699776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788797114.645751:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797114.645780:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984699776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.645812:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788797114.645833:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788797114.646580:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984700032:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.646919:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984700160:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.646985:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797114.647041:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875688984700672:0@lo:400:kworker.0 00000100:00100000:0.0:1788797114.647269:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700160 00000100:00100000:0.0:1788797114.647280:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700160 00000100:00100000:0.0:1788797114.647354:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788797114.647364:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984700160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797114.647622:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875688984700160:12345-0@lo:400:kworker.0 Request processed in 260us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797114.647630:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788797114.647662:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797114.647856:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797114.647883:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984701184:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649460:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.649532:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984700544:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649560:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.649581:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984701056:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649613:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.649672:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700032 00000100:00100000:1.0:1788797114.649698:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700032 00000100:00100000:1.0:1788797114.649756:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797114.649767:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984700032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649828:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984700032:12345-0@lo:400:kworker.0 Request processed in 63us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797114.649835:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788797114.649874:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984699904:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649909:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.649936:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984700416:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649960:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.649978:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1875688984700928:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.649999:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.650052:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984699776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788797114.650102:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788797114.650110:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984700288:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.650136:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.650156:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984700800:0@lo:400:kworker.0 00000100:00100000:1.0:1788797114.650178:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797114.650206:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984699904 00000100:00100000:1.0:1788797114.650210:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984699904 00000100:00100000:3.0:1788797114.650389:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700544 00000100:00100000:3.0:1788797114.650395:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700544 00000100:00100000:3.0:1788797114.650456:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797114.650465:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984700544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650507:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984700544:12345-0@lo:400:kworker.0 Request processed in 44us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650514:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788797114.650543:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700672 00000100:00100000:3.0:1788797114.650547:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700672 00000100:00100000:3.0:1788797114.650568:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701056 00000100:00100000:3.0:1788797114.650571:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701056 00000100:00100000:3.0:1788797114.650586:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700928 00000100:00100000:3.0:1788797114.650589:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700928 00000100:00100000:3.0:1788797114.650604:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700288 00000100:00100000:3.0:1788797114.650606:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700288 00000100:00100000:3.0:1788797114.650616:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700800 00000100:00100000:3.0:1788797114.650618:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700800 00000100:00100000:3.0:1788797114.650632:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797114.650639:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875688984700672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650673:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875688984700672:12345-0@lo:400:kworker.0 Request processed in 35us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650707:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788797114.650721:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797114.650727:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984701056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650757:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984701056:12345-0@lo:400:kworker.0 Request processed in 31us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650775:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788797114.650790:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797114.650796:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875688984700928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650833:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875688984700928:12345-0@lo:400:kworker.0 Request processed in 37us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650838:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788797114.650850:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788797114.650856:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984700288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650885:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984700288:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650890:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788797114.650902:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788797114.650907:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984700800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.650934:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984700800:12345-0@lo:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.650939:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788797114.650966:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788797114.650973:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3657:x1875688984699904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788797114.651003:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3657:x1875688984699904:12345-0@lo:400:kworker.0 Request processed in 31us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797114.651009:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1788797114.651148:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797114.651154:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797114.651158:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797114.651462:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797114.651522:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984699648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797114.651558:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3655:1875688984700160:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651571:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875688984700672:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651631:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984700416 00000100:00100000:2.0:1788797114.651638:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984700416 00000100:00100000:2.0:1788797114.651674:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797114.651707:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984700416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651750:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875688984700416:12345-0@lo:400:kworker.0 Request processed in 45us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797114.651756:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797114.651805:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984700032:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651818:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984700544:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651828:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984701056:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651861:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701184 00000100:00100000:2.0:1788797114.651864:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701184 00000100:00100000:2.0:1788797114.651896:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788797114.651902:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875688984701184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.651938:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875688984701184:12345-0@lo:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797114.651945:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788797114.651973:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4bfb2fb80 x1875688984701184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797114.651985:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3655:1875688984701184:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.652016:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984700288:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.652027:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984700800:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.652035:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984699904:0@lo:400:kworker.0 00000100:00100000:2.0:1788797114.652061:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3657:1875688984700416:0@lo:400:kworker.0 00010000:00080000:2.0:1788797114.652074:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb38820e680 x1875688984700928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788797114.652084:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3657:1875688984700928:0@lo:400:kworker.0 00000100:00080000:0.0:1788797114.652752:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1788797115.469324:0:25818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb546cf10 20000000:00000080:2.0:1788797115.469344:0:25818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fb4be98c000 uarg=0000000000000000 20000000:01000000:2.0:1788797115.470267:0:25818:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788797115.470275:0:25818:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788797115.470282:0:25818:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788797115.471518:0:25819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788797115.472095:0:25818:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788797115.481934:0:25818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788797115.481969:0:25818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482205:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482215:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266441 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482223:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266480 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482230:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482240:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482247:0:25818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482253:0:25818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482296:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482343:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 12 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.482358:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701312:192.168.201.27@tcp:104: 00010000:00010000:2.0:1788797115.482734:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482744:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.482753:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701440:192.168.201.27@tcp:104: 00010000:00010000:2.0:1788797115.482804:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482812:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.482821:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701568:0@lo:104: 00000100:00100000:2.0:1788797115.482861:0:25818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797115.482898:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.482906:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 23 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.482914:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701696:0@lo:104: 00000100:00100000:2.0:1788797115.482934:0:25818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797115.482975:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701568 00000100:00100000:2.0:1788797115.482983:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701568 00000100:00100000:2.0:1788797115.483050:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701696 00000100:00100000:2.0:1788797115.483053:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701696 00000100:00100000:2.0:1788797115.483069:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797115.483077:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:25818:x1875688984701568:12345-0@lo:104: 00010000:00010000:2.0:1788797115.483089:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483137:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797115.483143:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+4:25818:x1875688984701568:12345-0@lo:104: Request processed in 67us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797115.483149:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788797115.483168:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788797115.483174:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984701696:12345-0@lo:104: 00010000:00010000:2.0:1788797115.483180:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483213:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797115.483218:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984701696:12345-0@lo:104: Request processed in 46us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797115.483224:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788797115.483241:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788797115.483246:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483253:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:2.0:1788797115.483258:0:24735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483277:0:24735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797115.483284:0:24735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797115.483289:0:24735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797115.483315:0:24735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483334:0:24735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797115.483355:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483362:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4800/0x500835b7bd2665fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266601 expref: -99 pid: 25111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483376:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788797115.483378:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483418:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e800 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:2.0:1788797115.483421:0:24735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483428:0:24735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788797115.483434:0:24735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797115.483445:0:24735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788797115.483459:0:24735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483465:0:24735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788797115.483472:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483478:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb38682e800/0x500835b7bd266480 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266487 expref: -99 pid: 24288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483487:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797115.483489:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797115.483490:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797115.483502:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984701952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797115.483532:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797115.483554:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788797115.483559:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984701824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788797115.483578:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788797115.483611:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483620:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 23 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.483629:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984702080:0@lo:104: 00000100:00100000:2.0:1788797115.483649:0:25818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797115.483674:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702080 00000100:00100000:2.0:1788797115.483710:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702080 00000100:00100000:2.0:1788797115.483730:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797115.483736:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984702080:12345-0@lo:104: 00010000:00010000:2.0:1788797115.483743:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483777:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788797115.483782:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984702080:12345-0@lo:104: Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797115.483788:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788797115.483819:0:25818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483828:0:25818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797115.483835:0:25818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984702208:0@lo:104: 00000100:00100000:2.0:1788797115.483858:0:25818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797115.483876:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702208 00000100:00100000:2.0:1788797115.483880:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702208 00000100:00100000:2.0:1788797115.483896:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797115.483901:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984702208:12345-0@lo:104: 00010000:00010000:2.0:1788797115.483908:0:22771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797115.483937:0:22771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788797115.483942:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+3:25818:x1875688984702208:12345-0@lo:104: Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797115.483947:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797115.483977:0:25818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bd585840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797115.483998:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701568:0@lo:104: 00000100:00100000:2.0:1788797115.484007:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701696:0@lo:104: 00000100:00100000:2.0:1788797115.484013:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984702080:0@lo:104: 00000100:00100000:2.0:1788797115.484019:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984702208:0@lo:104: 00000100:00100000:3.0:1788797115.484750:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701952 00000100:00100000:3.0:1788797115.484756:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701952 00010000:00010000:3.0:1788797115.484794:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 24 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797115.484831:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984701824 00000100:00100000:3.0:1788797115.484834:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984701824 00010000:00010000:3.0:1788797115.484847:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 25 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797115.484866:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797115.484873:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+25:3657:x1875688984701952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797115.484884:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797115.484890:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 25 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.484899:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 25 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.484914:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29d800/0x500835b7bd266487 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd266480 expref: 25 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.484929:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797115.484972:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3657:x1875688984701952:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797115.484978:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788797115.484994:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797115.484999:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:3657:x1875688984701824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797115.485008:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797115.485012:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.485146:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.485163:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29ca00/0x500835b7bd266601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd2665fa expref: 23 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.485172:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797115.485197:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:3657:x1875688984701824:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797115.485203:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788797115.485242:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984701824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797115.485251:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943c4c9d-8ce2-4132-a4c5-0a007618de16:3657:1875688984701952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788797115.485753:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788797115.485762:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.485879:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb3881c4400 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:0.0:1788797115.485884:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.485893:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797115.485899:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797115.485905:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797115.485934:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.485940:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788797115.485996:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788797115.486257:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.486266:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb3881c4400/0x500835b7bd266441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd266448 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.486278:0:22776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788797115.486282:0:22776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.486288:0:22776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4be29de00 already unused, calling callback (ffffffffc1399c20) 10000000:00010000:0.0:1788797115.486290:0:22776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.486307:0:22776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788797115.486314:0:22776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797115.486332:0:22776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788797115.486349:0:22776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.486354:0:22776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788797115.486539:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797115.486905:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797115.487539:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984702464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797115.487602:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797115.487652:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984702336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797115.487673:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797115.487728:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702464 00000100:00100000:3.0:1788797115.487736:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702464 00010000:00010000:3.0:1788797115.487771:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 22 pid: 22782 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797115.487887:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702336 00000100:00100000:1.0:1788797115.487892:0:22774:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702336 00010000:00010000:1.0:1788797115.487910:0:22774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 23 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797115.487956:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788797115.487966:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:3655:x1875688984702464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788797115.487986:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797115.487993:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.488003:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.488046:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4be29d200/0x500835b7bd26643a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd266433 expref: 23 pid: 22782 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797115.488062:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797115.488116:0:22776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.488124:0:22776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.127@tcp lock: ffff8fb4be29de00/0x500835b7bd266433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x500835b7bd26643a expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.488140:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797115.488142:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788797115.488144:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797115.488560:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788797115.488569:0:22774:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:3655:x1875688984702336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788797115.488579:0:22774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797115.488584:0:22774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 22 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.488592:0:22774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 22 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.488603:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb38682f000/0x500835b7bd266448 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x500835b7bd266441 expref: 22 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.488612:0:22774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797115.488665:0:22774:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:3655:x1875688984702336:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797115.488736:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788797115.488834:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984702336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797115.489169:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:3655:x1875688984702464:12345-0@lo:103:ldlm_bl.0 Request processed in 1204us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797115.489177:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788797115.489355:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877fdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701312:192.168.201.27@tcp:104: 00000100:00100000:2.0:1788797115.489366:0:25818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3877ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25818:1875688984701440:192.168.201.27@tcp:104: 00010000:00010000:2.0:1788797115.489412:0:25818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797115.490639:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943c4c9d-8ce2-4132-a4c5-0a007618de16:3655:1875688984702464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788797115.494294:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797115.494480:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602688 00000100:00100000:0.0:1788797115.494491:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602688 00010000:00010000:0.0:1788797115.494533:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797115.494579:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:0.0:1788797115.494590:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2411:x1875688963602688:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797115.494609:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797115.494614:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.494643:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.494661:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb491dd1200/0x500835b7bd2667ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e063 expref: 13 pid: 22781 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.494677:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797115.494771:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:2411:x1875688963602688:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 182us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797115.494779:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 13 00000100:00100000:3.0:1788797115.496553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797115.496719:0:23941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602816 00000100:00100000:1.0:1788797115.496729:0:23941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602816 00010000:00010000:1.0:1788797115.496768:0:23941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797115.496894:0:23941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 14 00000100:00100000:1.0:1788797115.496905:0:23941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:268b5117-b5e2-4f6e-ae4a-1da250176944+12:2410:x1875688963602816:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797115.496919:0:23941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797115.496925:0:23941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.496937:0:23941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.496953:0:23941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4c20e7000/0x500835b7bd26676d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5dff3 expref: 12 pid: 22779 timeout: 931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.496981:0:23941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.496988:0:23941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497005:0:23941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497013:0:23941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497043:0:23941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497049:0:23941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497054:0:23941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797115.497058:0:23941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.497067:0:23941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.497557:0:25818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797115.497568:0:25818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.499276:0:23941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.499295:0:23941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fb4c20e7200/0x500835b7bd2667dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797115.499327:0:23941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797115.499420:0:23941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:268b5117-b5e2-4f6e-ae4a-1da250176944+11:2410:x1875688963602816:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 2513us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797115.499431:0:23941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 14 00010000:00010000:2.0:1788797115.541233:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788797115.668857:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984702592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797115.668933:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797115.670265:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702592 00000100:00100000:2.0:1788797115.670277:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702592 00000100:00100000:2.0:1788797115.670357:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788797115.670368:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984702592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788797115.670411:0:24296:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788797115.675553:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984702592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5176us (6608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797115.675567:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788797115.676874:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984702592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788797116.551214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797116.551345:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963602944 00000100:00100000:0.0:1788797116.551355:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963602944 00000100:00100000:0.0:1788797116.551993:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:0.0:1788797116.552007:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:18777:x1875688963602944:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797116.552028:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797116.552050:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2667e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e09b expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552119:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552145:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552172:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552190:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552197:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552204:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552284:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0200/0x500835b7bd2667f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552292:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0200/0x500835b7bd2667f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552300:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0200/0x500835b7bd2667f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797116.552331:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797116.552335:0:24941:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797116.552385:0:24941:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0200/0x500835b7bd2667f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552396:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552403:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552428:0:24941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552433:0:24941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797116.552437:0:24941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552445:0:24941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552457:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:0.0:1788797116.552461:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797116.552466:0:24941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552472:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd2667eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552485:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552490:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552496:0:24941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552501:0:24941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797116.552503:0:24941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552518:0:24941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552526:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fb386777000) 00010000:00010000:0.0:1788797116.552528:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797116.552531:0:24941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552537:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2667f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552577:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2667e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e09b expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552590:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0200/0x500835b7bd2667f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e09b expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.552597:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fb386777800) 00010000:00010000:0.0:1788797116.552599:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797116.552602:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd0200, rc 0) 00000100:00100000:0.0:1788797116.552668:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18777:x1875688963602944:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 666us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797116.552677:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00080000:2.0:1788797116.555396:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788797116.560150:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.560237:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603072 00000100:00100000:3.0:1788797116.560248:0:22799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603072 00000100:00100000:3.0:1788797116.560311:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1788797116.560322:0:22799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18777:x1875688963603072:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788797116.560420:0:22799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18777:x1875688963603072:12345-192.168.201.27@tcp:900:lhsmtool_posix.0 Request processed in 99us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.560429:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:3.0:1788797116.563797:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797116.563902:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603328 00000100:00100000:2.0:1788797116.563915:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603328 00000100:00100000:2.0:1788797116.564029:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:2.0:1788797116.564041:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18777:x1875688963603328:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797116.564078:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797116.564110:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7c00/0x500835b7bd266800 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0a2 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564191:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564206:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564216:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564230:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564236:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564245:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564355:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7200/0x500835b7bd266815 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564363:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7200/0x500835b7bd266815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564380:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7200/0x500835b7bd266815 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797116.564391:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788797116.564544:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564552:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564559:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564564:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e6800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797116.564568:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564574:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564586:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fb386777800) 00010000:00010000:2.0:1788797116.564589:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.564594:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564599:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266807 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564612:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564617:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564622:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564635:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797116.564638:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564644:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564652:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fb48822ef00) 00010000:00010000:2.0:1788797116.564654:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.564657:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.564665:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26680e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.567214:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788797116.574458:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7c00/0x500835b7bd266800 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0a2 expref: 10 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.574479:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7200/0x500835b7bd266815 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0a2 expref: 9 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.574487:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fb48822e100) 00010000:00010000:2.0:1788797116.574489:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.574491:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4c20e7200, rc 0) 00000100:00100000:2.0:1788797116.574554:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18777:x1875688963603328:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 10515us (10766us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788797116.574565:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 24 00000100:00100000:0.0:1788797116.591886:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.591997:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603456 00000100:00100000:3.0:1788797116.592006:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603456 00000100:00100000:3.0:1788797116.592068:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:3.0:1788797116.592092:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18777:x1875688963603456:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788797116.592210:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18777:x1875688963603456:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 Request processed in 121us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.592218:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:0.0:1788797116.619656:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797116.619832:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603584 00000100:00100000:1.0:1788797116.619843:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603584 00000100:00100000:1.0:1788797116.619917:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:1.0:1788797116.619930:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18777:x1875688963603584:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788797116.619947:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788797116.624227:0:22788:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4249us 00000100:00100000:0.0:1788797116.646562:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797116.646719:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603712 00000100:00100000:2.0:1788797116.646737:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603712 00000100:00100000:2.0:1788797116.646812:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:2.0:1788797116.646824:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18783:x1875688963603712:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1788797116.646846:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797116.646867:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd266823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0a9 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.646937:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.646951:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.646961:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647035:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647044:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647050:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647094:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647102:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647126:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647132:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e6800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797116.647137:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647146:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647158:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:2.0:1788797116.647161:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.647166:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647172:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd26682a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647198:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647205:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647211:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647217:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797116.647220:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647236:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647244:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:2.0:1788797116.647247:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.647249:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647255:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647286:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd266823 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0a9 expref: 10 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647296:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:2.0:1788797116.647299:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.647303:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd266823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0a9 expref: 10 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.647311:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4c20e7600, rc 0) 00000100:00100000:2.0:1788797116.647390:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18783:x1875688963603712:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 568us (838us total) trans 0 rc 301/301 00000100:00100000:2.0:1788797116.647397:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1788797116.656636:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.658963:0:22796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963603840 00000100:00100000:3.0:1788797116.658979:0:22796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963603840 00000100:00100000:3.0:1788797116.659027:0:22796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:3.0:1788797116.659038:0:22796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18783:x1875688963603840:12345-192.168.201.27@tcp:700:lfs.0 00000100:00100000:3.0:1788797116.659127:0:22796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18783:x1875688963603840:12345-192.168.201.27@tcp:700:lfs.0 Request processed in 90us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.659134:0:22796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:0.0:1788797116.661051:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18777:x1875688963603584:12345-192.168.201.27@tcp:59:lhsmtool_posix.0 Request processed in 41116us (41394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.661070:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797116.661079:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:0.0:1788797116.661110:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604096 00000100:00100000:0.0:1788797116.661117:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604096 00000100:00100000:0.0:1788797116.661160:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1788797116.661172:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:18783:x1875688963604096:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:0.0:1788797116.661228:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797116.661255:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd266797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e024 expref: 9 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.661273:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:0.0:1788797116.661278:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797116.661337:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.661352:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 5 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.661362:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.661410:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 5 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.661424:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 5 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797116.661438:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22788:1875688984702720:192.168.201.27@tcp:104: 00000100:00100000:0.0:1788797116.661504:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788797116.668803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797116.669013:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22788:1875688984702720:192.168.201.27@tcp:104: 00010000:00010000:0.0:1788797116.669039:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797116.669519:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604224 00000100:00100000:1.0:1788797116.669529:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604224 00010000:00010000:1.0:1788797116.669588:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 6 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797116.669621:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 15 00000100:00100000:1.0:1788797116.669631:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2410:x1875688963604224:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797116.669647:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797116.669655:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 6 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.669669:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 6 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788797116.669996:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788797116.670039:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2667d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e094 expref: 6 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.670059:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:1.0:1788797116.670064:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.670073:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.670081:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.670124:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788797116.670265:0:22788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.670273:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.670317:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.670327:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.670335:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797116.671117:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2410:x1875688963604224:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 1484us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797116.671130:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 15 00010000:00010000:2.0:1788797116.683725:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683754:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683768:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797116.683788:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcce4f5c reply state 00000000e04b02a6 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683801:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683808:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:2.0:1788797116.683811:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788797116.683816:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788797116.683821:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788797116.683831:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683838:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683858:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683864:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797116.683869:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683877:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683887:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907bd700) 00010000:00010000:2.0:1788797116.683890:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797116.683893:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683900:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266838 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797116.683917:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcce4f5c reply state 00000000e04b02a6 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683926:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.683931:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:2.0:1788797116.683933:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788797116.683934:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788797116.684046:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+10:18783:x1875688963604096:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 22872us (22977us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788797116.684055:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:3.0:1788797116.691995:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797116.692017:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984702848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788797116.692017:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984702976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788797116.694344:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797116.694398:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788797116.694418:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984703104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797116.694454:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797116.695012:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702976 00000100:00100000:1.0:1788797116.695021:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702976 00000100:00100000:1.0:1788797116.695083:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788797116.695105:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984702976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788797116.695130:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788797116.695186:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984702976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797116.695193:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788797116.695216:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797116.696009:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797116.696108:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984702976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797116.708031:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703104 00000100:00100000:2.0:1788797116.708050:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703104 00000100:00100000:2.0:1788797116.708127:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984702848 00000100:00100000:2.0:1788797116.708141:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984702848 00000100:00100000:2.0:1788797116.708163:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788797116.708174:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984703104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788797116.708215:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788797116.708310:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984703104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (13854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797116.708316:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788797116.708335:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788797116.708341:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984702848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788797116.708360:0:22793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788797116.708404:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984702848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (12396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797116.708410:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788797116.708933:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984702848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788797116.711170:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984703104:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788797116.756529:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788797116.798139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797116.798250:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604352 00000100:00100000:1.0:1788797116.798260:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604352 00000100:00100000:1.0:1788797116.798397:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:1.0:1788797116.798408:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+10:18791:x1875688963604352:12345-192.168.201.27@tcp:101:lctl.0 00010000:00010000:1.0:1788797116.798431:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797116.798453:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd26684d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0b0 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.798510:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682ee00/0x500835b7bd266854 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.798523:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682ee00/0x500835b7bd266854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.798549:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682ee00/0x500835b7bd266854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797116.798598:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788797116.798602:0:22787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797116.799459:0:22787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682ee00/0x500835b7bd266854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.799487:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd26684d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0b0 expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.799506:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682ee00/0x500835b7bd266854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0b0 expref: 11 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.799515:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:1.0:1788797116.799518:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788797116.799522:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682ee00, rc 0) 00000100:00100000:1.0:1788797116.799579:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+11:18791:x1875688963604352:12345-192.168.201.27@tcp:101:lctl.0 Request processed in 1174us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797116.799587:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:1.0:1788797116.849907:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.850143:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604480 00000100:00100000:3.0:1788797116.850154:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604480 00000100:00100000:3.0:1788797116.850232:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:3.0:1788797116.850243:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:18792:x1875688963604480:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1788797116.850265:0:24940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797116.850287:0:24940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd26685b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0b7 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850373:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682600/0x500835b7bd266862 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850389:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682600/0x500835b7bd266862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850421:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682600/0x500835b7bd266862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797116.850474:0:24940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788797116.850478:0:24940:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788797116.850504:0:24940:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682600/0x500835b7bd266862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850532:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd26685b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0b7 expref: 7 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850553:0:24940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682600/0x500835b7bd266862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0b7 expref: 6 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.850563:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:3.0:1788797116.850566:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797116.850570:0:24940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497682600, rc 0) 00000100:00100000:3.0:1788797116.850641:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18792:x1875688963604480:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 400us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.850649:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:2.0:1788797116.860636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797116.860732:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604608 00000100:00100000:0.0:1788797116.860744:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604608 00000100:00100000:0.0:1788797116.860842:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:0.0:1788797116.860853:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:18792:x1875688963604608:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:0.0:1788797116.860874:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797116.860894:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0be expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861637:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861654:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861666:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861738:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861746:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861754:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861830:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861838:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861844:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797116.861883:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788797116.861887:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797116.861906:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861917:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861924:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861931:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861946:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797116.861951:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861958:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861970:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:0.0:1788797116.861974:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797116.861979:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.861985:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1600/0x500835b7bd266870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862001:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862008:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862014:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862019:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797116.862022:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862138:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862157:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:0.0:1788797116.862159:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788797116.862163:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862168:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266877 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862207:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0be expref: 8 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862221:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0be expref: 7 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797116.862228:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:0.0:1788797116.862230:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788797116.862233:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1000, rc 0) 00000100:00100000:0.0:1788797116.862292:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+7:18792:x1875688963604608:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1441us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797116.862301:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:2.0:1788797116.874889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.875134:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604736 00000100:00100000:3.0:1788797116.875146:0:22799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604736 00000100:00100000:3.0:1788797116.875338:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:3.0:1788797116.875349:0:22799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:18792:x1875688963604736:12345-192.168.201.27@tcp:900:lfs.0 00000100:00100000:3.0:1788797116.875550:0:22799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:18792:x1875688963604736:12345-192.168.201.27@tcp:900:lfs.0 Request processed in 202us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.875558:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00080000:1.0:1788797116.879291:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788797116.881910:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797116.882397:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963604992 00000100:00100000:2.0:1788797116.882410:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963604992 00000100:00100000:2.0:1788797116.882833:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:2.0:1788797116.882846:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+7:18792:x1875688963604992:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:2.0:1788797116.882868:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797116.882892:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0c5 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797116.883463:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788797116.883564:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266885 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0c5 expref: 9 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.883581:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:2.0:1788797116.883584:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797116.883590:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd266885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0c5 expref: 9 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797116.883605:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4c20e7000, rc 0) 00000100:00100000:2.0:1788797116.883677:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+8:18792:x1875688963604992:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 833us (1775us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788797116.884503:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 32 00000100:00100000:0.0:1788797116.890636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.890716:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963605248 00000100:00100000:3.0:1788797116.890727:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963605248 00000100:00100000:3.0:1788797116.890781:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:3.0:1788797116.890790:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+8:18792:x1875688963605248:12345-192.168.201.27@tcp:36:lfs.0 00010000:00010000:3.0:1788797116.890842:0:24941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797116.890871:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1000/0x500835b7bd26687e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0be expref: 8 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.890890:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:3.0:1788797116.890895:0:24941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797116.890915:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.890928:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.890948:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797116.891158:0:24941:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083111848 reply state 00000000f3efac61 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.891171:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.891178:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:3.0:1788797116.891181:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788797116.891183:0:24941:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788797116.891190:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788797116.891271:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+9:18792:x1875688963605248:12345-192.168.201.27@tcp:36:lfs.0 Request processed in 481us (644us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788797116.891293:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 33 00000100:00100000:0.0:1788797116.894923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797116.895185:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963605504 00000100:00100000:2.0:1788797116.895282:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963605504 00000100:00100000:2.0:1788797116.895385:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:2.0:1788797116.895396:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+9:18792:x1875688963605504:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1788797116.895626:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+10:18792:x1875688963605504:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 233us (713us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788797116.895634:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1788797116.902250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.902344:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963605760 00000100:00100000:3.0:1788797116.902357:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963605760 00000100:00100000:3.0:1788797116.902433:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:3.0:1788797116.902444:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+10:18792:x1875688963605760:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1788797116.902468:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797116.902488:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682a00/0x500835b7bd26689a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0cc expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902561:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902576:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902588:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902599:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902606:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902613:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797116.902754:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788797116.902825:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902850:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902857:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902863:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797116.902867:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902875:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902887:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:3.0:1788797116.902890:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797116.902896:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902902:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd2668a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902914:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902919:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902925:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902929:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797116.902952:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902960:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902969:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:3.0:1788797116.902972:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797116.902975:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.902982:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.903136:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682a00/0x500835b7bd26689a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0cc expref: 12 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.903148:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:3.0:1788797116.903150:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788797116.903154:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682a00/0x500835b7bd26689a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0cc expref: 12 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.903163:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497682a00, rc 0) 00000100:00100000:3.0:1788797116.903220:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+11:18792:x1875688963605760:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 777us (981us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788797116.903228:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 34 00000100:00100000:0.0:1788797116.906375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.906501:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963605888 00000100:00100000:3.0:1788797116.906511:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963605888 00000100:00100000:3.0:1788797116.906568:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:3.0:1788797116.906578:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+11:18792:x1875688963605888:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1788797116.906610:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797116.906632:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd2668b6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0d3 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906741:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906755:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906766:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797116.906794:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788797116.906797:0:24941:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788797116.906816:0:24941:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906843:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683c00/0x500835b7bd2668b6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 13 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906859:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 12 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.906867:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:3.0:1788797116.906870:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788797116.906873:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683000, rc 0) 00000100:00100000:3.0:1788797116.906933:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:18792:x1875688963605888:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 357us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.906948:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 35 00000100:00100000:0.0:1788797116.910600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797116.911997:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606016 00000100:00100000:1.0:1788797116.912011:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606016 00000100:00100000:1.0:1788797116.912085:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:1.0:1788797116.912097:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:18792:x1875688963606016:12345-192.168.201.27@tcp:37:lfs.0 00000100:00100000:2.0:1788797116.917876:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:18792:x1875688963606016:12345-192.168.201.27@tcp:37:lfs.0 Request processed in 5771us (7277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797116.917889:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 3 00000100:00100000:0.0:1788797116.925626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797116.926174:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606272 00000100:00100000:2.0:1788797116.926186:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606272 00000100:00100000:2.0:1788797116.926543:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:2.0:1788797116.926553:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38690fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:18792:x1875688963606272:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:2.0:1788797116.926809:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38690fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+13:18792:x1875688963606272:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 256us (1192us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788797116.926817:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 4 00000100:00100000:0.0:1788797116.932490:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.932595:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606400 00000100:00100000:3.0:1788797116.932606:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606400 00000100:00100000:3.0:1788797116.932665:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 150 00000100:00100000:3.0:1788797116.932676:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+11:18160:x1875688963606400:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797116.932723:0:22782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797116.932744:0:22782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb497683c00/0x500835b7bd2668c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0da expref: -99 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.932782:0:22782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb497683c00/0x500835b7bd2668c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0da expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.932794:0:22782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb497683c00/0x500835b7bd2668c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0da expref: 12 pid: 22782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797116.932803:0:22782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683c00, rc 0) 00000100:00100000:3.0:1788797116.932860:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4971e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606400:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 186us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.932867:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 150 00000100:00100000:0.0:1788797116.938737:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797116.939231:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606528 00000100:00100000:1.0:1788797116.939242:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606528 00000100:00100000:1.0:1788797116.939300:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 151 00000100:00100000:1.0:1788797116.939310:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606528:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797116.941466:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606528:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 2148us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797116.941481:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 151 00000040:00080000:2.0:1788797116.950357:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788797116.956963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797116.957104:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606656 00000100:00100000:3.0:1788797116.957114:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606656 00000100:00100000:3.0:1788797116.957173:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 152 00000100:00100000:3.0:1788797116.957183:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606656:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797116.957352:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606656:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 170us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797116.957370:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 152 00000100:00100000:0.0:1788797116.968620:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797116.968929:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606784 00000100:00100000:1.0:1788797116.968949:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606784 00000100:00100000:1.0:1788797116.969017:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 153 00000100:00100000:1.0:1788797116.969029:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+12:18160:x1875688963606784:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797116.969047:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797116.969066:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682fe00/0x500835b7bd2668cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0e1 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.969094:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682fe00/0x500835b7bd2668cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0e1 expref: 13 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.969107:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682fe00/0x500835b7bd2668cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0e1 expref: 13 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797116.969116:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682fe00, rc 0) 00000100:00100000:1.0:1788797116.969179:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18160:x1875688963606784:12345-192.168.201.27@tcp:101:ll_cfg_requeue.0 Request processed in 152us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797116.969186:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 153 00000100:00100000:1.0:1788797116.986081:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797116.996554:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963606912 00000100:00100000:0.0:1788797116.996571:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963606912 00000100:00100000:0.0:1788797116.996641:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 154 00000100:00100000:0.0:1788797116.996651:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18160:x1875688963606912:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797116.996864:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18160:x1875688963606912:12345-192.168.201.27@tcp:501:ll_cfg_requeue.0 Request processed in 213us (10793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797116.996873:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 154 00000100:00100000:0.0:1788797117.018966:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.019111:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607040 00000100:00100000:3.0:1788797117.019121:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607040 00000100:00100000:3.0:1788797117.019191:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:3.0:1788797117.019201:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18160:x1875688963607040:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797117.019343:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:18160:x1875688963607040:12345-192.168.201.27@tcp:503:ll_cfg_requeue.0 Request processed in 142us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.019351:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 155 00000100:00100000:2.0:1788797117.033127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797117.033255:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607168 00000100:00100000:1.0:1788797117.033266:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607168 00000100:00100000:1.0:1788797117.033337:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:1.0:1788797117.033347:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+11:18799:x1875688963607168:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:1.0:1788797117.033379:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797117.033401:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e400/0x500835b7bd2668d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0e8 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033468:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033484:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033496:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033506:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033515:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033522:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033624:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e800/0x500835b7bd2668e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033633:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e800/0x500835b7bd2668e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033662:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e800/0x500835b7bd2668e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797117.033759:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788797117.033763:0:22787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788797117.033805:0:22787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e800/0x500835b7bd2668e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033819:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033826:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033833:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033839:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797117.033844:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033851:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033866:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:1.0:1788797117.033869:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797117.033875:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033882:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f400/0x500835b7bd2668d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033906:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033912:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033918:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033923:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682f000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797117.033926:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033932:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033940:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:1.0:1788797117.033942:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797117.033945:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033951:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682f000/0x500835b7bd2668e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.033978:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e400/0x500835b7bd2668d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0e8 expref: 13 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.034292:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e800/0x500835b7bd2668e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0e8 expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.034313:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:1.0:1788797117.034316:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788797117.034319:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682e800, rc 0) 00000100:00100000:1.0:1788797117.034438:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+12:18799:x1875688963607168:12345-192.168.201.27@tcp:101:bash.0 Request processed in 1091us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797117.034446:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 36 00000100:00100000:1.0:1788797117.040316:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797117.040423:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607296 00000100:00100000:0.0:1788797117.040434:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607296 00000100:00100000:0.0:1788797117.040538:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1788797117.040550:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18799:x1875688963607296:12345-192.168.201.27@tcp:900:bash.0 00000100:00100000:0.0:1788797117.040652:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:18799:x1875688963607296:12345-192.168.201.27@tcp:900:bash.0 Request processed in 104us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.040661:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1788797117.044076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.044205:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607552 00000100:00100000:3.0:1788797117.044215:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607552 00000100:00100000:3.0:1788797117.044276:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:3.0:1788797117.044287:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+12:18799:x1875688963607552:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:3.0:1788797117.044309:0:24940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797117.044331:0:24940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682a00/0x500835b7bd2668ee lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0ef expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.044459:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.044475:0:24940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 12 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.044484:0:24940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.044515:0:24940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 12 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.044529:0:24940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 12 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797117.044562:0:24940:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24940:1875688984703232:192.168.201.27@tcp:104: 00000100:00100000:3.0:1788797117.044804:0:24940:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb385967300 going to sleep for 11 seconds 00000100:00100000:2.0:1788797117.054964:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797117.055062:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607680 00000100:00100000:0.0:1788797117.055072:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607680 00010000:00010000:0.0:1788797117.055115:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 13 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797117.055158:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 16 00000100:00100000:0.0:1788797117.055169:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+13:2409:x1875688963607680:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797117.055204:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797117.055211:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 13 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.055224:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 13 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.055246:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:0.0:1788797117.055253:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.055263:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.055269:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.055285:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797117.055333:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+13:2409:x1875688963607680:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 166us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.055337:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 16 00010000:00010000:3.0:1788797117.056717:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683000/0x500835b7bd2668bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0d3 expref: 12 pid: 24941 timeout: 932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797117.056736:0:24940:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb38813f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24940:1875688984703232:192.168.201.27@tcp:104: 00010000:00010000:3.0:1788797117.056754:0:24940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.056809:0:24940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.056817:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.056891:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.056901:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.056907:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057665:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057676:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057708:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797117.057730:0:24940:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788797117.057760:0:24940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057767:0:24940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057774:0:24940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057780:0:24940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797117.057784:0:24940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057791:0:24940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057803:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:2.0:1788797117.057806:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788797117.057810:0:24940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057816:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682000/0x500835b7bd2668f5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788797117.057828:0:24940:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c18a3397 reply state 00000000fded2cdb transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057839:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057855:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8fb48822e400) 00010000:00010000:2.0:1788797117.057857:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788797117.057860:0:24940:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788797117.057896:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682a00/0x500835b7bd2668ee lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 15 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057912:0:24940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 14 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.057918:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:2.0:1788797117.057920:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788797117.057922:0:24940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9000, rc 0) 00000100:00100000:2.0:1788797117.058214:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+15:18799:x1875688963607552:12345-192.168.201.27@tcp:101:bash.0 Request processed in 13928us (14145us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788797117.058223:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 37 00000100:00100000:2.0:1788797117.084511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797117.087733:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963607808 00000100:00100000:0.0:1788797117.087751:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963607808 00000100:00100000:0.0:1788797117.087836:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:0.0:1788797117.087848:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+15:18799:x1875688963607808:12345-192.168.201.27@tcp:101:bash.0 00010000:00010000:0.0:1788797117.087877:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797117.087899:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266911 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0f6 expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.087999:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088021:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088035:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797117.088082:0:22789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788797117.088087:0:22789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788797117.088108:0:22789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088118:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088140:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266911 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 17 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088159:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 16 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.088166:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797117.088170:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788797117.088173:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1e00, rc 0) 00000100:00100000:0.0:1788797117.089390:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+16:18799:x1875688963607808:12345-192.168.201.27@tcp:101:bash.0 Request processed in 1538us (4883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.089401:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 38 00000100:00100000:0.0:1788797117.108266:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797117.108701:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608064 00000100:00100000:1.0:1788797117.108713:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608064 00000100:00100000:1.0:1788797117.108831:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 5 00000100:00100000:1.0:1788797117.108842:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+16:18799:x1875688963608064:12345-192.168.201.27@tcp:35:bash.0 00000001:00080000:1.0:1788797117.109085:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:1.0:1788797117.109189:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+18:18799:x1875688963608064:12345-192.168.201.27@tcp:35:bash.0 Request processed in 348us (935us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788797117.109202:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 5 00000020:00080000:1.0:1788797117.109208:0:22790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 10000000:01000000:1.0:1788797117.203834:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788797117.203842:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb388872000 from 13 10000000:01000000:1.0:1788797117.203847:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788797117.203893:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.203904:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.203915:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797117.203955:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.204025:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797117.204073:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797117.205835:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703360 00000100:00100000:2.0:1788797117.205849:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703360 00000100:00100000:2.0:1788797117.205912:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788797117.205922:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+20:22784:x1875688984703360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797117.205938:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797117.205954:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4830e9600/0x500835b7bd266926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26691f expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.205991:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4830e9600/0x500835b7bd266926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26691f expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.206019:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4830e9600/0x500835b7bd266926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26691f expref: 21 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.206027:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9600, rc 0) 00000100:00100000:2.0:1788797117.206105:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.206111:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788797117.206745:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797117.206765:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266926 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.206774:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266926 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797117.206848:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.206886:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797117.206929:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970840 going to sleep for 11 seconds 00000100:00100000:0.0:1788797117.207110:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703488 00000100:00100000:0.0:1788797117.207118:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703488 00000100:00100000:0.0:1788797117.207159:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788797117.207168:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.208837:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1664us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.208848:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788797117.211450:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.211525:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.211616:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797117.211664:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797117.215470:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703616 00000100:00100000:3.0:1788797117.215488:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703616 00000100:00100000:3.0:1788797117.215561:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788797117.215573:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797117.215772:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (4155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.215779:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788797117.216262:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788797117.220532:0:25832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788797117.220835:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788797117.220859:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797117.220873:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266926 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.220886:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb38682f400/0x500835b7bd26691f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266926 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797117.220898:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788797117.220902:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb4a008a800 from 13 10000000:01000000:0.0:1788797117.220905:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797117.220946:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.220954:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.220966:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797117.220993:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.221077:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797117.221118:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797117.221450:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703744 00000100:00100000:2.0:1788797117.221458:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703744 00000100:00100000:2.0:1788797117.221509:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788797117.221527:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+21:22784:x1875688984703744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797117.221540:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797117.221553:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb4830e9200/0x500835b7bd266934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26692d expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.221577:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb4830e9200/0x500835b7bd266934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26692d expref: 22 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.221588:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb4830e9200/0x500835b7bd266934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26692d expref: 22 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.221607:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9200, rc 0) 00000100:00100000:2.0:1788797117.221652:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984703744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.221659:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788797117.222012:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788797117.222030:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266934 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.222039:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266934 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797117.222100:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.222128:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797117.222157:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797117.222219:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984703872 00000100:00100000:3.0:1788797117.222224:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984703872 00000100:00100000:3.0:1788797117.222264:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788797117.222280:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984703872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788797117.222412:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984703872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.222419:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788797117.222712:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984703872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.222742:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.222787:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797117.222815:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797117.222992:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704000 00000100:00100000:3.0:1788797117.223004:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704000 00000100:00100000:3.0:1788797117.223037:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788797117.223045:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984704000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788797117.223121:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984704000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.223128:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788797117.223401:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788797117.226963:0:25833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788797117.231439:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788797117.231476:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788797117.231488:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266934 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.231501:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1600/0x500835b7bd26692d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266934 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788797117.231523:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788797117.231542:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb488901800 from 13 10000000:01000000:0.0:1788797117.231546:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788797117.231584:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.231592:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797117.231614:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797117.231641:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.231938:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797117.231973:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788797117.232117:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704128 00000100:00100000:3.0:1788797117.232126:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704128 00000100:00100000:3.0:1788797117.232181:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788797117.232369:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+22:22784:x1875688984704128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788797117.232384:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797117.232401:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb497683000/0x500835b7bd266942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd26693b expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.232429:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb497683000/0x500835b7bd266942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd26693b expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.232440:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb497683000/0x500835b7bd266942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd26693b expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.232449:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683000, rc 0) 00000100:00100000:3.0:1788797117.232502:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.232508:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788797117.232733:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfbd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797117.232750:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266942 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.232760:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266942 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797117.232832:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.232863:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797117.232881:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797117.232949:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704256 00000100:00100000:2.0:1788797117.232959:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704256 00000100:00100000:2.0:1788797117.232983:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788797117.233000:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.233114:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.233120:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788797117.233242:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.233269:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.233314:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797117.233341:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb387970840 going to sleep for 11 seconds 00000100:00100000:2.0:1788797117.233462:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704384 00000100:00100000:2.0:1788797117.233467:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704384 00000100:00100000:2.0:1788797117.233485:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788797117.233491:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.233588:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.233595:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788797117.233881:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bfb01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788797117.235125:0:25834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788797117.238119:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788797117.238154:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788797117.238165:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266942 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.238178:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb491dd1000/0x500835b7bd26693b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266942 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788797117.238189:0:22784:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788797117.238204:0:22784:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fb4b9fd8800 from 13 10000000:01000000:2.0:1788797117.238207:0:22784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788797117.238471:0:22784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.238480:0:22784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.238510:0:22784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797117.238546:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.238789:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797117.238840:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77480 going to sleep for 11 seconds 00000100:00100000:1.0:1788797117.238900:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704512 00000100:00100000:1.0:1788797117.238908:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704512 00000100:00100000:1.0:1788797117.238962:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788797117.238972:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+23:22784:x1875688984704512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788797117.238996:0:22779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797117.239010:0:22779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fb38682f600/0x500835b7bd266950 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x500835b7bd266949 expref: -99 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.239033:0:22779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fb38682f600/0x500835b7bd266950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x500835b7bd266949 expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.239044:0:22779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fb38682f600/0x500835b7bd266950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x500835b7bd266949 expref: 24 pid: 22779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.239053:0:22779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682f600, rc 0) 00000100:00100000:1.0:1788797117.239098:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984704512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797117.239113:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788797117.239415:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788797117.239429:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266950 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.239438:0:22784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x500835b7bd266950 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797117.239496:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.239675:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797117.240157:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77480 going to sleep for 11 seconds 00000100:00100000:0.0:1788797117.249936:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704640 00000100:00100000:0.0:1788797117.249952:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704640 00000100:00100000:0.0:1788797117.250040:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788797117.250050:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984704640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.250454:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bd4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984704640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (10555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.250462:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788797117.251485:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.251539:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788797117.251605:0:22784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797117.251635:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae77480 going to sleep for 11 seconds 00000100:00100000:1.0:1788797117.251738:0:22779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984704768 00000100:00100000:1.0:1788797117.251744:0:22779:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984704768 00000100:00100000:1.0:1788797117.251791:0:22779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788797117.251801:0:22779:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984704768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788797117.251906:0:22779:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:22784:x1875688984704768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797117.251915:0:22779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788797117.252185:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252260:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252291:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252371:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.252392:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608576 00000100:00100000:3.0:1788797117.252396:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608576 00000100:00100000:3.0:1788797117.252428:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963609088 00000100:00100000:3.0:1788797117.252431:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963609088 00000100:00100000:3.0:1788797117.252444:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608704 00000100:00100000:3.0:1788797117.252446:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608704 00000100:00100000:3.0:1788797117.252458:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963609216 00000100:00100000:3.0:1788797117.252460:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963609216 00000100:00100000:3.0:1788797117.252474:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1788797117.252481:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608576:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797117.252524:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608576:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.252531:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:3.0:1788797117.252542:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:3.0:1788797117.252548:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963609088:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797117.252567:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963609088:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 20us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.252573:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:3.0:1788797117.252581:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:3.0:1788797117.252586:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608704:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797117.252603:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608704:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 17us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.252615:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:3.0:1788797117.252625:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00100000:3.0:1788797117.252631:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963609216:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797117.252652:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963609216:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 21us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.252657:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 23 00000100:00080000:3.0:1788797117.252677:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788797117.252704:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797117.252713:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608192 00000100:00100000:3.0:1788797117.252716:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608192 00000100:00100000:3.0:1788797117.252735:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 168 00000100:00100000:3.0:1788797117.252741:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2409:x1875688963608192:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797117.252765:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2409:x1875688963608192:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797117.252770:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 168 00000100:00100000:0.0:1788797117.252786:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608320 00000100:00100000:0.0:1788797117.252790:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608320 00000100:00100000:3.0:1788797117.252792:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608832 00000100:00100000:3.0:1788797117.252795:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608832 00000100:00100000:3.0:1788797117.252869:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608448 00000100:00100000:3.0:1788797117.252874:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608448 00000100:00100000:0.0:1788797117.257528:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963608960 00000100:00100000:0.0:1788797117.257545:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963608960 00000100:00100000:0.0:1788797117.257595:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:0.0:1788797117.257607:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:2409:x1875688963608832:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1788797117.257662:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:2.0:1788797117.257673:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+18:2409:x1875688963608320:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788797117.257705:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+12:2409:x1875688963608832:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 100us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.257713:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+18:2409:x1875688963608320:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 44us (5531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.257729:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:0.0:1788797117.257736:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:2.0:1788797117.257753:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:2.0:1788797117.262856:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608448:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:2.0:1788797117.262957:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2409:x1875688963608448:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 5194us (10646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.263723:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:0.0:1788797117.263741:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3877fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963608960:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788797117.263792:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3877fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2409:x1875688963608960:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 59us (11451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797117.263799:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:2.0:1788797117.265781:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:2.0:1788797117.265840:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943c4c9d-8ce2-4132-a4c5-0a007618de16:22784:1875688984704768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788797117.270259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797117.270537:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963609472 00000100:00100000:1.0:1788797117.270548:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963609472 00000100:00100000:1.0:1788797117.270609:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 39 00000100:00100000:1.0:1788797117.270619:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+18:18810:x1875688963609472:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:1.0:1788797117.270639:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797117.270659:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682fc00/0x500835b7bd266957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e0fd expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788797117.270780:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788797117.270883:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682fc00/0x500835b7bd266957 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0fd expref: 20 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.270898:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fb4907e3400) 00010000:00010000:1.0:1788797117.270902:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788797117.270907:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682fc00/0x500835b7bd266957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0fd expref: 20 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.270921:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682fc00, rc 0) 00000100:00100000:1.0:1788797117.270995:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+19:18810:x1875688963609472:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 378us (746us total) trans 12884901899 rc 301/301 00000100:00100000:1.0:1788797117.271003:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 39 00000040:00080000:2.0:1788797117.273398:0:25835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788797117.278100:0:22784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788797117.278149:0:22784:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788797117.278161:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266950 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.278173:0:22784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.127@tcp lock: ffff8fb4830e8800/0x500835b7bd266949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x500835b7bd266950 expref: -99 pid: 22784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797117.279066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.279221:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963609728 00000100:00100000:3.0:1788797117.279232:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963609728 00000100:00100000:3.0:1788797117.279290:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:3.0:1788797117.279301:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+19:18810:x1875688963609728:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1788797117.279539:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18810:x1875688963609728:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 239us (478us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788797117.279565:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 6 00000100:00100000:0.0:1788797117.375800:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.375937:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963609984 00000100:00100000:3.0:1788797117.375948:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963609984 00000100:00100000:3.0:1788797117.376018:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:3.0:1788797117.376368:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18813:x1875688963609984:12345-192.168.201.27@tcp:101:lfs.0 00010000:00010000:3.0:1788797117.376395:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797117.376421:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd266965 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e104 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.376537:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683e00/0x500835b7bd26696c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.376552:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683e00/0x500835b7bd26696c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.376564:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683e00/0x500835b7bd26696c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797117.376575:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788797117.377313:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd266965 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e104 expref: 23 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.377336:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683e00/0x500835b7bd26696c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e104 expref: 22 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797117.377345:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:3.0:1788797117.377348:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788797117.377361:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683e00, rc 0) 00000100:00100000:3.0:1788797117.377448:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18813:x1875688963609984:12345-192.168.201.27@tcp:101:lfs.0 Request processed in 1420us (1657us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788797117.377457:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 40 00000100:00100000:0.0:1788797117.389878:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797117.390473:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963610112 00000100:00100000:2.0:1788797117.390484:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963610112 00000100:00100000:2.0:1788797117.390547:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:2.0:1788797117.390559:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18813:x1875688963610112:12345-192.168.201.27@tcp:54:lfs.0 00010000:00010000:2.0:1788797117.390637:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390656:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390721:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390757:0:22789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390765:0:22789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390788:0:22789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390794:0:22789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4830e8c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:2.0:1788797117.390798:0:22789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390806:0:22789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390819:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:2.0:1788797117.390822:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788797117.390828:0:22789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797117.390834:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8c00/0x500835b7bd26697a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797117.390899:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18813:x1875688963610112:12345-192.168.201.27@tcp:54:lfs.0 Request processed in 343us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797117.390907:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 41 00000100:00100000:0.0:1788797117.394471:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797117.394546:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963610368 00000100:00100000:3.0:1788797117.394556:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963610368 00000100:00100000:3.0:1788797117.394619:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:3.0:1788797117.394631:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18813:x1875688963610368:12345-192.168.201.27@tcp:35:lfs.0 00000100:00100000:3.0:1788797117.395291:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+23:18813:x1875688963610368:12345-192.168.201.27@tcp:35:lfs.0 Request processed in 660us (827us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788797117.395300:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 7 00000100:00100000:0.0:1788797117.407738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797117.407892:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963610496 00000100:00100000:1.0:1788797117.407902:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963610496 00000100:00100000:1.0:1788797117.407964:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:1.0:1788797117.407974:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+23:2409:x1875688963610496:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797117.407990:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797117.408011:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683e00/0x500835b7bd26696c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e104 expref: 23 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797117.408042:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797117.408048:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797117.408105:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:2409:x1875688963610496:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 132us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797117.408112:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00010000:00010000:2.0:1788797117.587919:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788797117.785564:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788797118.005028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797118.005383:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963610752 00000100:00100000:2.0:1788797118.005396:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963610752 00000100:00100000:2.0:1788797118.005483:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00100000:2.0:1788797118.005494:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18844:x1875688963610752:12345-192.168.201.27@tcp:101:cat.0 00010000:00010000:2.0:1788797118.005520:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797118.005543:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266981 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e10b expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.005711:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9e00/0x500835b7bd266988 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.005726:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9e00/0x500835b7bd266988 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.005738:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9e00/0x500835b7bd266988 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797118.005750:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788797118.005877:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266981 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e10b expref: 25 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.005896:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9e00/0x500835b7bd266988 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e10b expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.005905:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:2.0:1788797118.005908:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797118.005912:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9e00, rc 0) 00000100:00100000:2.0:1788797118.005980:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:18844:x1875688963610752:12345-192.168.201.27@tcp:101:cat.0 Request processed in 488us (961us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788797118.005987:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 42 00000100:00080000:3.0:1788797118.006461:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788797118.013293:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797118.013351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797118.013460:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611136 00000100:00100000:0.0:1788797118.013471:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611136 00000100:00100000:0.0:1788797118.013538:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:0.0:1788797118.013548:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:2408:x1875688963611136:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797118.013565:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797118.013599:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9e00/0x500835b7bd266988 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e10b expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.013619:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797118.013624:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797118.013722:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+23:2408:x1875688963611136:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 133us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797118.013732:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:1.0:1788797118.013891:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611008 00000100:00100000:1.0:1788797118.013896:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611008 00000100:00100000:1.0:1788797118.013939:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:1.0:1788797118.013946:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+23:18844:x1875688963611008:12345-192.168.201.27@tcp:35:cat.0 00000100:00100000:1.0:1788797118.014194:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:18844:x1875688963611008:12345-192.168.201.27@tcp:35:cat.0 Request processed in 248us (910us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788797118.014201:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 8 00000100:00100000:2.0:1788797118.102554:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797118.102628:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611392 00000100:00100000:3.0:1788797118.102641:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611392 00000100:00100000:3.0:1788797118.102775:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:3.0:1788797118.102787:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:18850:x1875688963611392:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:3.0:1788797118.102815:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797118.102838:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd266996 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e112 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.102961:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.102987:0:24941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.102995:0:24941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 25 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.103044:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.103077:0:24941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 25 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.103090:0:24941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 25 pid: 22789 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797118.103104:0:24941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24941:1875688984704896:192.168.201.27@tcp:104: 00010000:00010000:3.0:1788797118.103199:0:24941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.103209:0:24941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797118.103218:0:24941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb387b91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24941:1875688984705024:192.168.201.27@tcp:104: 00000100:00100000:3.0:1788797118.103245:0:24941:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb488107540 going to sleep for 11 seconds 00000100:00100000:3.0:1788797118.107408:0:24941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24941:1875688984704896:192.168.201.27@tcp:104: 00000100:00100000:3.0:1788797118.107427:0:24941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb387b91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:24941:1875688984705024:192.168.201.27@tcp:104: 00010000:00010000:3.0:1788797118.107466:0:24941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797118.109260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797118.109406:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611520 00000100:00100000:1.0:1788797118.109415:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611520 00010000:00010000:1.0:1788797118.109466:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 26 pid: 22789 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797118.109506:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:1.0:1788797118.109516:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+26:2411:x1875688963611520:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797118.109532:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797118.109539:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 26 pid: 22789 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.109551:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 26 pid: 22789 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.109572:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266918 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0f6 expref: 26 pid: 22789 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.109588:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797118.109594:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.109603:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.109622:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797118.109725:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+25:2411:x1875688963611520:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 168us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797118.109733:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 17 00000100:00100000:0.0:1788797118.112625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797118.112794:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611648 00000100:00100000:3.0:1788797118.112803:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611648 00010000:00010000:3.0:1788797118.112860:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797118.112904:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 18 00000100:00100000:3.0:1788797118.112914:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+25:2411:x1875688963611648:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797118.112938:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797118.112945:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.112958:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.112988:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266903 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e0ef expref: 25 pid: 24940 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.113239:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:3.0:1788797118.113246:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.113257:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.113265:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.113296:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797118.113363:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387781c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:2411:x1875688963611648:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 450us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797118.113370:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 18 00010000:00010000:0.0:1788797118.113902:0:24941:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.113911:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797118.113939:0:24941:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788797118.114317:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682400/0x500835b7bd266996 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e112 expref: 25 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.114336:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682e00/0x500835b7bd26699d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e112 expref: 24 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.114356:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797118.114359:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788797118.114362:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497682e00, rc 0) 00000100:00100000:0.0:1788797118.114408:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:18850:x1875688963611392:12345-192.168.201.27@tcp:101:dd.0 Request processed in 11623us (11866us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1788797118.114415:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 43 00000100:00100000:0.0:1788797118.119644:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797118.119731:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963611776 00000100:00100000:1.0:1788797118.119742:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963611776 00000100:00100000:1.0:1788797118.119805:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:1.0:1788797118.119814:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+24:18850:x1875688963611776:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:1.0:1788797118.119838:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788797118.119857:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e200/0x500835b7bd2669ab lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e119 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.119889:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.119903:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.119924:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.120076:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e200/0x500835b7bd2669ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 26 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.120095:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 25 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797118.120104:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797118.120114:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788797118.120118:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb38682e600, rc 0) 00000100:00100000:1.0:1788797118.120178:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+25:18850:x1875688963611776:12345-192.168.201.27@tcp:101:dd.0 Request processed in 365us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797118.120186:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 44 00000100:00100000:3.0:1788797118.125930:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797118.126117:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612032 00000100:00100000:0.0:1788797118.126128:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612032 00000100:00100000:0.0:1788797118.126185:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 45 00000100:00100000:0.0:1788797118.126195:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+25:18850:x1875688963612032:12345-192.168.201.27@tcp:36:dd.0 00010000:00010000:0.0:1788797118.126581:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.126601:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.126629:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797118.126676:0:24940:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:0.0:1788797118.126750:0:24940:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c621511 reply state 0000000093f93d6a transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.126762:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.126770:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797118.126773:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788797118.126777:0:24940:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788797118.126867:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612032:12345-192.168.201.27@tcp:36:dd.0 Request processed in 672us (955us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788797118.126874:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 45 00000020:00080000:0.0:1788797118.126880:0:24940:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788797118.130297:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797118.130394:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612160 00000100:00100000:3.0:1788797118.130405:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612160 00000100:00100000:3.0:1788797118.130565:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:3.0:1788797118.130576:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612160:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:3.0:1788797118.130600:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797118.130620:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683800/0x500835b7bd2669c0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e120 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.130723:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683800/0x500835b7bd2669c0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e120 expref: 29 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.130739:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683800/0x500835b7bd2669c0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e120 expref: 29 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797118.130757:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:3.0:1788797118.130761:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788797118.130765:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683800, rc 0) 00000100:00100000:3.0:1788797118.130819:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18850:x1875688963612160:12345-192.168.201.27@tcp:101:dd.0 Request processed in 245us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797118.130827:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 46 00000100:00100000:1.0:1788797118.149330:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797118.149447:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612416 00000100:00100000:0.0:1788797118.149459:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612416 00000100:00100000:0.0:1788797118.149528:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1788797118.149540:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18850:x1875688963612416:12345-192.168.201.27@tcp:103:dd.0 00010000:00010000:0.0:1788797118.149560:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797118.149589:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683800/0x500835b7bd2669c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e120 expref: 29 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.149612:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797118.149617:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797118.149887:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612416:12345-192.168.201.27@tcp:103:dd.0 Request processed in 348us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797118.149894:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 2 00000100:00100000:0.0:1788797118.152904:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797118.153181:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612544 00000100:00100000:2.0:1788797118.153202:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612544 00000100:00100000:2.0:1788797118.153285:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:2.0:1788797118.153296:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612544:12345-192.168.201.27@tcp:58:dd.0 00010000:00010000:2.0:1788797118.153418:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.153438:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797118.153547:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788797118.154877:0:22788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788797118.154910:0:22788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788797118.155352:0:22788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788797118.155610:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612544:12345-192.168.201.27@tcp:58:dd.0 Request processed in 2311us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797118.155621:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 47 00000100:00100000:2.0:1788797118.158651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797118.158777:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612672 00000100:00100000:0.0:1788797118.158788:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612672 00000100:00100000:0.0:1788797118.158838:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 48 00000100:00100000:0.0:1788797118.158848:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+28:18850:x1875688963612672:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:0.0:1788797118.158867:0:24940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797118.158887:0:24940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e127 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.158952:0:24940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.158963:0:24940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 29 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.158991:0:24940:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.159011:0:24940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 29 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.159024:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797118.159027:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797118.159030:0:24940:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 29 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797118.159055:0:24940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1200, rc 0) 00000100:00100000:0.0:1788797118.159117:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18850:x1875688963612672:12345-192.168.201.27@tcp:101:dd.0 Request processed in 270us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797118.159124:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 48 00010000:00010000:0.0:1788797118.611851:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788797118.995980:0:22823:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788797118.995990:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788797118.996038:0:22823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788797118.996046:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788797118.996544:0:22823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22823:1875688984705152:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788797118.996644:0:22823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788797119.011245:0:22823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4bab25c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22823:1875688984705152:192.168.201.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788797119.021131:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.023637:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612800 00000100:00100000:0.0:1788797119.023662:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612800 00000100:00100000:0.0:1788797119.023782:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:0.0:1788797119.023793:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18851:x1875688963612800:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788797119.023827:0:24941:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788797119.023957:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18851:x1875688963612800:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 165us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.023965:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 49 00000100:00100000:2.0:1788797119.036028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.036172:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963612928 00000100:00100000:3.0:1788797119.036182:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963612928 00000100:00100000:3.0:1788797119.036254:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:3.0:1788797119.036265:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18851:x1875688963612928:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788797119.036366:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036384:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036396:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036411:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036419:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036425:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036446:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036455:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036462:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788797119.036506:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788797119.036510:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788797119.036538:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036549:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036560:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036567:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036573:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.036577:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036584:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036595:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fb48822e100) 00010000:00010000:3.0:1788797119.036598:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797119.036603:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036609:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd2669d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036622:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036627:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036633:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036638:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.036644:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036651:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036658:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8fb4907bd600) 00010000:00010000:3.0:1788797119.036661:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797119.036664:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036670:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd2669dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036731:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036737:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036743:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036748:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.036751:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036756:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036762:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:3.0:1788797119.036764:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797119.036772:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.036778:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797119.036838:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18851:x1875688963612928:12345-192.168.201.27@tcp:34:lhsmtool_posix.0 Request processed in 574us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.036845:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 50 00000100:00100000:1.0:1788797119.048572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.048738:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963613184 00000100:00100000:0.0:1788797119.048749:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963613184 00000100:00100000:0.0:1788797119.048819:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:0.0:1788797119.048830:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+29:18851:x1875688963613184:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797119.048848:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797119.048884:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd2669ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e12e expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.048989:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049004:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049030:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788797119.049043:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788797119.049118:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049125:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049131:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049137:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797119.049142:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049149:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049159:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797119.049162:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788797119.049167:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049172:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd2669f1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049213:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd2669ea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e12e expref: 31 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049234:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fb48822e100) 00010000:00010000:0.0:1788797119.049236:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788797119.049240:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd2669ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e12e expref: 31 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.049250:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1800, rc 0) 00000100:00100000:0.0:1788797119.049434:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+30:18851:x1875688963613184:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 605us (870us total) trans 12884901908 rc 301/301 00000100:00100000:0.0:1788797119.049442:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 51 00000100:00100000:0.0:1788797119.057265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.057369:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963613312 00000100:00100000:2.0:1788797119.057379:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963613312 00000100:00100000:2.0:1788797119.057441:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:2.0:1788797119.057451:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+30:18851:x1875688963613312:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788797119.057500:0:22789:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788797119.057622:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+30:18851:x1875688963613312:12345-192.168.201.27@tcp:53:lhsmtool_posix.0 Request processed in 172us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.057629:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 52 00000100:00100000:2.0:1788797119.064463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.064784:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963613568 00000100:00100000:3.0:1788797119.064794:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963613568 00000100:00100000:3.0:1788797119.064858:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:3.0:1788797119.064870:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+30:18851:x1875688963613568:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797119.064893:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797119.064916:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669ff lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e135 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788797119.065471:0:22788:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1788797119.065478:0:22788:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788797119.065510:0:22788:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788797119.069095:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8a00/0x500835b7bd266a06 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.069128:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8a00/0x500835b7bd266a06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.069140:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8a00/0x500835b7bd266a06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.069207:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683200/0x500835b7bd2669ff lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e135 expref: 33 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.069228:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8a00/0x500835b7bd266a06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e135 expref: 32 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.069238:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822e600) 00010000:00010000:2.0:1788797119.069241:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788797119.069245:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e8a00, rc 0) 00000100:00100000:2.0:1788797119.069331:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+32:18851:x1875688963613568:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 4453us (4869us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788797119.069341:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 53 00000100:00100000:1.0:1788797119.081512:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.081767:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963613824 00000100:00100000:3.0:1788797119.081777:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963613824 00000100:00100000:3.0:1788797119.081839:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:3.0:1788797119.081849:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+32:18851:x1875688963613824:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788797119.081907:0:24941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797119.081931:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8a00/0x500835b7bd266a06 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e135 expref: 32 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.081951:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822e600) 00010000:00010000:3.0:1788797119.081976:0:24941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797119.082015:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.082029:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.082041:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.082056:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.082063:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.082070:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083799:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083816:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083823:0:24941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083830:0:24941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682c00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.083834:0:24941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083841:0:24941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083871:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:3.0:1788797119.083874:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797119.083879:0:24941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083885:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a14 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083901:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083908:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083914:0:24941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083920:0:24941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497683400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.083923:0:24941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083929:0:24941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083936:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb6c2af0c (ffff8fb4907bd600) 00010000:00010000:3.0:1788797119.083939:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788797119.083942:0:24941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.083948:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497683400/0x500835b7bd266a1b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb6c2af0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797119.084302:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+31:18851:x1875688963613824:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 2449us (2795us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788797119.084312:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 54 00000100:00100000:0.0:1788797119.098009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.101202:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963613952 00000100:00100000:2.0:1788797119.101217:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963613952 00000100:00100000:2.0:1788797119.101307:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:2.0:1788797119.101317:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+31:18851:x1875688963613952:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797119.101347:0:24940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797119.101373:0:24940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a22 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e13c expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101410:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9c00/0x500835b7bd266a29 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101424:0:24940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9c00/0x500835b7bd266a29 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101435:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9c00/0x500835b7bd266a29 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101543:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e13c expref: 33 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101563:0:24940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9c00/0x500835b7bd266a29 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e13c expref: 32 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.101573:0:24940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:2.0:1788797119.101576:0:24940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788797119.101580:0:24940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9c00, rc 0) 00000100:00100000:2.0:1788797119.101660:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+32:18851:x1875688963613952:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 343us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.101667:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 55 00000100:00100000:2.0:1788797119.122430:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.122545:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963614208 00000100:00100000:0.0:1788797119.122557:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963614208 00000100:00100000:0.0:1788797119.122629:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:0.0:1788797119.122649:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bab27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+32:18851:x1875688963614208:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788797119.122775:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.122792:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.122803:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788797119.122983:0:22788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788797119.122994:0:22788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 834910312080ns, next at 835910309839ns, rc = 0 00000004:00010000:0.0:1788797119.123043:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4144f02 reply state 00000000ffff6bd1 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.123069:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.123077:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:0.0:1788797119.123081:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788797119.123084:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788797119.123191:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bab27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+34:18851:x1875688963614208:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 552us (770us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1788797119.123198:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 56 00000100:00100000:3.0:1788797119.134501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.134618:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963614336 00000100:00100000:0.0:1788797119.134629:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963614336 00000100:00100000:0.0:1788797119.134717:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:0.0:1788797119.134727:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38813df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+34:18851:x1875688963614336:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788797119.134751:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788797119.134770:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e143 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.134827:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 35 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.134843:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 35 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.134863:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:0.0:1788797119.134866:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797119.134870:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb491dd1800, rc 0) 00000100:00100000:0.0:1788797119.134931:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38813df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+35:18851:x1875688963614336:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 205us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.134961:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 57 00000100:00100000:3.0:1788797119.145787:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.146001:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963614464 00000100:00100000:0.0:1788797119.146013:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963614464 00000100:00100000:0.0:1788797119.146094:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00100000:0.0:1788797119.146106:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963614464:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788797119.146369:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2411:x1875688963614464:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 264us (590us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788797119.146376:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 25 00000100:00080000:3.0:1788797119.146561:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788797119.153773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797119.153942:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963614720 00000100:00100000:1.0:1788797119.153961:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963614720 00000100:00100000:1.0:1788797119.154019:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1788797119.154031:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+35:18851:x1875688963614720:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788797119.154274:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+36:18851:x1875688963614720:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 244us (509us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788797119.154283:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 9 00000100:00100000:1.0:1788797119.157822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.157931:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963614976 00000100:00100000:0.0:1788797119.157941:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963614976 00000100:00100000:0.0:1788797119.158014:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1788797119.158025:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+36:18851:x1875688963614976:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788797119.158178:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+36:18851:x1875688963614976:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 154us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.158186:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 58 00000100:00100000:0.0:1788797119.173930:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.174017:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963615104 00000100:00100000:2.0:1788797119.174037:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963615104 00000100:00100000:2.0:1788797119.174098:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:2.0:1788797119.174108:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+36:18851:x1875688963615104:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797119.174129:0:22789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797119.174148:0:22789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9400/0x500835b7bd266a3e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e14a expref: -99 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174220:0:22789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174236:0:22789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174248:0:22789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788797119.174294:0:22789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788797119.174313:0:22789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174349:0:22789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9400/0x500835b7bd266a3e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e14a expref: 38 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174367:0:22789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e14a expref: 37 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.174375:0:22789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:2.0:1788797119.174379:0:22789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788797119.174382:0:22789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e8000, rc 0) 00000100:00100000:2.0:1788797119.174447:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+37:18851:x1875688963615104:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 340us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.174461:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 59 00000100:00100000:2.0:1788797119.184472:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.184629:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963615232 00000100:00100000:3.0:1788797119.184641:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963615232 00000100:00100000:3.0:1788797119.184730:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:3.0:1788797119.184741:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2410:x1875688963615232:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788797119.184760:0:24595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788797119.184780:0:24595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e151 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788797119.184806:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ee0bf, blocks: 0x0 00010000:00010000:3.0:1788797119.184827:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=834s v=(0 0) 00010000:00010000:3.0:1788797119.184832:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797119.184842:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 7 pid: 24595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.184862:0:24595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 7 pid: 24595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.184876:0:24595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb497683400, rc 0) 00000100:00100000:3.0:1788797119.184936:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2410:x1875688963615232:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 197us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.184943:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:0.0:1788797119.199148:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.199247:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963615488 00000100:00100000:2.0:1788797119.199259:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963615488 00000100:00100000:2.0:1788797119.199329:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1788797119.199341:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+37:18851:x1875688963615488:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788797119.199454:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+37:18851:x1875688963615488:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 113us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.199462:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 60 00000100:00100000:2.0:1788797119.208127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.212371:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963615616 00000100:00100000:0.0:1788797119.212387:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963615616 00000100:00100000:0.0:1788797119.212522:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:0.0:1788797119.212534:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+37:18851:x1875688963615616:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788797119.216562:0:22767:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:3.0:1788797119.216579:0:22767:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788797119.216731:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216744:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216752:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216759:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.216763:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216785:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216803:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8fb48822ef00) 00010000:00010000:1.0:1788797119.216807:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797119.216812:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216819:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7600/0x500835b7bd26683f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216840:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216847:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216853:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216858:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e6800 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.216861:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216867:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216892:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:1.0:1788797119.216895:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797119.216899:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216911:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e6800/0x500835b7bd266846 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216928:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216934:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216940:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216945:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4c20e7000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.216958:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216965:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216974:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8fb48822e400) 00010000:00010000:1.0:1788797119.216976:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797119.216979:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.216986:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4c20e7000/0x500835b7bd2668fc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217001:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217008:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217022:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217026:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd0a00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.217029:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217034:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217041:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797119.217044:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797119.217046:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217052:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd0a00/0x500835b7bd2669b9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217062:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217068:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217073:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217078:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb491dd1e00 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.217080:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217096:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217104:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:1.0:1788797119.217106:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788797119.217110:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.217115:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1e00/0x500835b7bd266a30 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.221215:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984705280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788797119.221290:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788797119.221391:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984705280 00000100:00100000:2.0:1788797119.221399:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984705280 00000100:00100000:2.0:1788797119.221471:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788797119.221480:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3880d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875688984705280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788797119.221619:0:24294:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788797119.221623:0:24294:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788797119.221625:0:24294:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788797119.221627:0:24294:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788797119 -> 1788797119 00002000:00010000:2.0:1788797119.221630:0:24294:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:3.0:1788797119.223258:0:22767:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00080000:3.0:1788797119.223293:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788797119.223344:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223357:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223364:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223370:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682200 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:3.0:1788797119.223375:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223382:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223397:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8fb48822ea00) 00010000:00010000:3.0:1788797119.223400:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788797119.223406:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.223424:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266893 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797119.223728:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+15:18851:x1875688963615616:12345-192.168.201.27@tcp:44:lhsmtool_posix.0 Request processed in 11192us (15605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.223739:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 61 00000100:00100000:3.0:1788797119.227944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.228310:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963615744 00000100:00100000:0.0:1788797119.228332:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963615744 00000100:00100000:0.0:1788797119.228393:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:0.0:1788797119.228403:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2411:x1875688963615744:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788797119.228518:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2411:x1875688963615744:12345-192.168.201.27@tcp:16:lhsmtool_posix.0 Request processed in 116us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.228526:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:2.0:1788797119.232792:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3880d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875688984705280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 11304us (11493us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788797119.232807:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1788797119.235182:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fb4befadc00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788797119.235197:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984705280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788797119.240367:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.240485:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616000 00000100:00100000:3.0:1788797119.240494:0:24941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616000 00000100:00100000:3.0:1788797119.240554:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:3.0:1788797119.240565:0:24941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+15:18851:x1875688963616000:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788797119.240626:0:24941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797119.240654:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8000/0x500835b7bd266a45 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e14a expref: 15 pid: 22789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.240675:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:3.0:1788797119.240698:0:24941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788797119.240730:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a53 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.240745:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a53 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.240755:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a53 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788797119.241145:0:24941:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009901e63b reply state 000000002e883d88 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a53 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.241159:0:24941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682c00/0x500835b7bd266a53 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.241165:0:24941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:3.0:1788797119.241167:0:24941:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788797119.241170:0:24941:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788797119.241275:0:24941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e5596e1-adfd-4fce-a2cd-12fb575d153a+16:18851:x1875688963616000:12345-192.168.201.27@tcp:36:lhsmtool_posix.0 Request processed in 711us (915us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1788797119.241301:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 62 00000100:00100000:0.0:1788797119.243506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.243598:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616128 00000100:00100000:2.0:1788797119.243619:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616128 00000100:00100000:2.0:1788797119.243674:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:2.0:1788797119.243710:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:18851:x1875688963616128:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788797119.243741:0:24293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797119.243759:0:24293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e158 expref: -99 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.243792:0:24293:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.243801:0:24293:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788797119.243805:0:24293:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797119.243810:0:24293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 8 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.243841:0:24293:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.243854:0:24293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 935 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.243866:0:24293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24293:1875688984705408:192.168.201.27@tcp:104: 00000100:00100000:1.0:1788797119.244625:0:24293:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4bae779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797119.246392:0:24293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24293:1875688984705408:192.168.201.27@tcp:104: 00010000:00010000:0.0:1788797119.246425:0:24293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 8 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.246444:0:24293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e9400, rc 0) 00000100:00100000:0.0:1788797119.246505:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:18851:x1875688963616128:12345-192.168.201.27@tcp:101:lhsmtool_posix.0 Request processed in 2821us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.246513:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:3.0:1788797119.246809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797119.246917:0:23941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616256 00000100:00100000:1.0:1788797119.246923:0:23941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616256 00010000:00010000:1.0:1788797119.246960:0:23941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 935 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.246994:0:23941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:1.0:1788797119.247002:0:23941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:2410:x1875688963616256:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788797119.247015:0:23941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788797119.247036:0:23941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 935 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.247065:0:23941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 935 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.247089:0:23941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e775be52/0x500835b7bd266a4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e151 expref: 8 pid: 24595 timeout: 935 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.247103:0:23941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797119.247107:0:23941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788797119.247113:0:23941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 7 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.247123:0:23941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 7 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.247156:0:23941:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 7 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.247170:0:23941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:23941:1875688984705536:192.168.201.27@tcp:105: 00000100:00100000:1.0:1788797119.247230:0:23941:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788797119.254579:0:23941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:23941:1875688984705536:192.168.201.27@tcp:105: 00010000:00010000:1.0:1788797119.254609:0:23941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788797119.254670:0:23941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4b9ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2410:x1875688963616256:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 7668us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797119.254716:0:23941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 19 00000100:00100000:2.0:1788797119.255605:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.255674:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616384 00000100:00100000:3.0:1788797119.255704:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616384 00000100:00100000:3.0:1788797119.255747:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:3.0:1788797119.255755:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2410:x1875688963616384:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788797119.255904:0:24295:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788797119.255908:0:24295:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788797118 00002000:00010000:3.0:1788797119.255911:0:24295:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788797116 00002000:00010000:3.0:1788797119.255913:0:24295:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788797119 -> 1788797118 00002000:00010000:3.0:1788797119.255916:0:24295:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788797119.256049:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:2410:x1875688963616384:12345-192.168.201.27@tcp:2:lhsmtool_posix.0 Request processed in 293us (446us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788797119.256056:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 30 00000100:00100000:2.0:1788797119.269929:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.269987:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616512 00000100:00100000:0.0:1788797119.269997:0:24595:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616512 00000100:00100000:0.0:1788797119.270101:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:0.0:1788797119.270112:0:24595:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:2411:x1875688963616512:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788797119.270156:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.270187:0:24595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 8 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.270223:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788797119.270228:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797119.270233:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.270269:0:24595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 8 pid: 24293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.270285:0:24595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 8 pid: 24293 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797119.270302:0:24595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24595:1875688984705664:192.168.201.27@tcp:104: 00000100:00100000:0.0:1788797119.270402:0:24595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788797119.275367:0:24595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24595:1875688984705664:192.168.201.27@tcp:104: 00010000:00010000:3.0:1788797119.275394:0:24595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.276108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.276196:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616640 00000100:00100000:0.0:1788797119.276205:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616640 00010000:00010000:0.0:1788797119.276247:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 9 pid: 24293 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797119.276291:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 20 00000100:00100000:0.0:1788797119.276302:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+9:2411:x1875688963616640:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788797119.276327:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788797119.276349:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 9 pid: 24293 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.276381:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 9 pid: 24293 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.276405:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f259c9/0x500835b7bd266a5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e158 expref: 9 pid: 24293 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.276422:0:22772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797119.276427:0:22772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788797119.276432:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.276443:0:22772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.276468:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788797119.276512:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:2411:x1875688963616640:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 213us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.276517:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 20 00010000:00010000:3.0:1788797119.276881:0:24595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276892:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276915:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276932:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276940:0:24595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276948:0:24595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4813d0e00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:3.0:1788797119.276953:0:24595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276962:0:24595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276975:0:24595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.276983:0:24595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1037d79/0x500835b7bd266a61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797119.277041:0:24595:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5596e1-adfd-4fce-a2cd-12fb575d153a+7:2411:x1875688963616512:12345-192.168.201.27@tcp:1:lhsmtool_posix.0 Request processed in 6931us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.277049:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 31 00000100:00100000:2.0:1788797119.282157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797119.282253:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963616896 00000100:00100000:0.0:1788797119.282263:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963616896 00000100:00100000:0.0:1788797119.282335:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 63 00000100:00100000:0.0:1788797119.282345:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+16:18851:x1875688963616896:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788797119.282424:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.282460:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 16 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.282470:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.282502:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 16 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.282515:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 16 pid: 22787 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797119.282529:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4beface00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984705792:192.168.201.27@tcp:104: 00000100:00100000:0.0:1788797119.282608:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3859a5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797119.286427:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.286502:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617024 00000100:00100000:3.0:1788797119.286511:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617024 00010000:00010000:3.0:1788797119.286550:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 17 pid: 22787 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788797119.286607:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 21 00000100:00100000:3.0:1788797119.286617:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+17:2410:x1875688963617024:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788797119.286634:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788797119.286641:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 17 pid: 22787 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286653:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 17 pid: 22787 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286675:0:22773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:3.0:1788797119.286716:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 17 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286726:0:22773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286734:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286740:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.286761:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788797119.286806:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+17:2410:x1875688963617024:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.286814:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 21 00010000:00010000:1.0:1788797119.287428:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd2669b2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e119 expref: 16 pid: 22787 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.287449:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4beface00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984705792:192.168.201.27@tcp:104: 00010000:00010000:1.0:1788797119.287470:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287479:0:22787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287485:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287726:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287738:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 16 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287746:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287775:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 16 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.287789:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 16 pid: 24941 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.287813:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984705920:192.168.201.27@tcp:104: 00000100:00100000:1.0:1788797119.288031:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb498aeacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788797119.293769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797119.293893:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb3881a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984705920:192.168.201.27@tcp:104: 00010000:00010000:1.0:1788797119.293929:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.294191:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617152 00000100:00100000:2.0:1788797119.294200:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617152 00010000:00010000:2.0:1788797119.294237:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 17 pid: 24941 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.294292:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:2.0:1788797119.294302:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+17:2410:x1875688963617152:12345-192.168.201.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788797119.294329:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788797119.294337:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 17 pid: 24941 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294350:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 17 pid: 24941 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294371:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1800/0x500835b7bd266a37 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e143 expref: 17 pid: 24941 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294387:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:2.0:1788797119.294393:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294402:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294410:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.294439:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788797119.294560:0:22787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.294568:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788797119.294701:0:22787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788797119.294810:0:22787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:0.0:1788797119.294843:0:22787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788797119.294929:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22787:1875688984706048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797119.294985:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.295018:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706048 00000100:00100000:0.0:1788797119.295030:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706048 00000100:00100000:0.0:1788797119.295061:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788797119.295067:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22787:x1875688984706048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797119.295129:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22787:x1875688984706048:12345-0@lo:1000:mdt00_000.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.295137:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788797119.295165:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb4a1d5ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788797119.295186:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22787:1875688984706048:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788797119.295314:0:22787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:0.0:1788797119.295360:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22787:1875688984706176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797119.295385:0:22787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.295404:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706176 00000100:00100000:0.0:1788797119.295407:0:22793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706176 00000100:00100000:0.0:1788797119.295428:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788797119.295435:0:22793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22787:x1875688984706176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788797119.295517:0:22793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22787:x1875688984706176:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (131us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788797119.295524:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788797119.295540:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb488107900 going to sleep for 11 seconds 00000100:00100000:0.0:1788797119.295554:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22787:1875688984706176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788797119.295576:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295585:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295593:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295605:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e000 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797119.295609:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295617:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295629:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:0.0:1788797119.295632:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797119.295637:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295642:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e000/0x500835b7bd266a6f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295673:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295713:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295720:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295726:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4830e8600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:0.0:1788797119.295729:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295735:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295755:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797119.295757:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788797119.295763:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 20 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295773:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 20 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295781:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 20 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.295832:0:22787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fb491dd1200/0x500835b7bd2669ce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e127 expref: 20 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788797119.295842:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984706304:192.168.201.27@tcp:105: 00000100:00100000:2.0:1788797119.296611:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:2410:x1875688963617152:12345-192.168.201.27@tcp:103:ldlm_bl.0 Request processed in 2305us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.296622:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 22 00000100:00100000:2.0:1788797119.300183:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.300423:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617280 00000100:00100000:3.0:1788797119.300441:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617280 00000100:00100000:3.0:1788797119.300502:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:3.0:1788797119.300512:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb38690e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18850:x1875688963617280:12345-192.168.201.27@tcp:49:dd.0 00000100:00100000:3.0:1788797119.300655:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb38690e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18850:x1875688963617280:12345-192.168.201.27@tcp:49:dd.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.300663:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 10 00000100:00100000:0.0:1788797119.304763:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797119.304843:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617408 00000100:00100000:2.0:1788797119.304853:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617408 00000100:00100000:2.0:1788797119.304925:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 64 00000100:00100000:2.0:1788797119.304935:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18850:x1875688963617408:12345-192.168.201.27@tcp:101:dd.0 00010000:00010000:2.0:1788797119.304964:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788797119.304985:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266a76 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5bff048a26c5e15f expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.305022:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.305239:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.305445:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.305472:0:22788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.305484:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.306351:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fb3810cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788797119.306395:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22787:1875688984706304:192.168.201.27@tcp:105: 00010000:00010000:1.0:1788797119.306420:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306429:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8600/0x500835b7bd2669c7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306458:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306471:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306482:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306492:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306498:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306523:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306529:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb38682e600 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.306532:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306540:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306553:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797119.306556:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788797119.306559:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306564:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb38682e600/0x500835b7bd266a84 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306575:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306594:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306601:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306606:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4bad28400 already unused, calling callback (ffffffffc19aa4f0) 00010000:00010000:1.0:1788797119.306609:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306625:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306633:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:1.0:1788797119.306635:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788797119.306638:0:22787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306645:0:22787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306652:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306703:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.306709:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4bad28400/0x500835b7bd266a68 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788797119.306914:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+21:18851:x1875688963616896:12345-192.168.201.27@tcp:57:lhsmtool_posix.0 Request processed in 24569us (24766us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788797119.306924:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 63 00000020:00080000:1.0:1788797119.306929:0:22787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:0.0:1788797119.307926:0:22788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.307937:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.308079:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e9000/0x500835b7bd266a76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e15f expref: 21 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.308108:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb4830e8e00/0x500835b7bd266a7d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.27@tcp remote: 0x5bff048a26c5e15f expref: 20 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788797119.308130:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8fb48822e000) 00010000:00010000:0.0:1788797119.308132:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788797119.308135:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fb4830e8e00, rc 0) 00000100:00100000:0.0:1788797119.308178:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18850:x1875688963617408:12345-192.168.201.27@tcp:101:dd.0 Request processed in 3244us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.308185:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 64 00000040:00080000:3.0:1788797119.308475:0:22823:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788797119.308480:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797119.308497:0:22823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788797119.308504:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788797119.312552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.312712:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617664 00000100:00100000:3.0:1788797119.312723:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617664 00000100:00100000:3.0:1788797119.312781:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 11 00000100:00100000:3.0:1788797119.312792:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+20:18851:x1875688963617664:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788797119.313246:0:22790:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788797119.313277:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:3.0:1788797119.313312:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313342:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313355:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313364:0:22790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313370:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313391:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.313412:0:22790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788797119.313496:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:18851:x1875688963617664:12345-192.168.201.27@tcp:35:lhsmtool_posix.0 Request processed in 705us (953us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788797119.313504:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 11 00000020:00080000:3.0:1788797119.313509:0:22790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788797119.313618:0:24735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788797119.313625:0:24735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.313632:0:24735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:1.0:1788797119.313636:0:24735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.313652:0:24735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.313665:0:24735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8fb48822ee00) 00010000:00010000:1.0:1788797119.313668:0:24735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788797119.313673:0:24735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.313694:0:24735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fb497682200/0x500835b7bd266a8b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788797119.313708:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797119.313710:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788797119.313712:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788797119.524772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797119.524819:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:3.0:1788797119.524911:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617792 00000100:00100000:3.0:1788797119.524922:0:24299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617792 00000100:00100000:3.0:1788797119.524997:0:24299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963617920 00000100:00100000:3.0:1788797119.525001:0:24299:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963617920 00000100:00100000:3.0:1788797119.525022:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:3.0:1788797119.525032:0:24299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+8:2411:x1875688963617792:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:3.0:1788797119.525081:0:24299:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ee0be, atime: 0x6a9ee0bc, ctime: 0x6a9ee0be, blocks: 0x0 00010000:00010000:3.0:1788797119.525090:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.525109:0:24299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=835s v=(0 0) 00010000:00010000:3.0:1788797119.525113:0:24299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788797119.525120:0:24299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788797119.525133:0:24299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788797119.621200:0:24289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788797119.621231:0:24289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1788797119.621504:0:24299:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788797119.621508:0:24299:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788797118 -> 1788797119 00002000:00010000:2.0:1788797119.621510:0:24299:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788797118 -> 1788797119 00002000:00010000:2.0:1788797119.621511:0:24299:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788797119.621526:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621545:0:24299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621552:0:24299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621556:0:24299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb497682200 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797119.621560:0:24299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621567:0:24299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621583:0:24299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621588:0:24299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a0224a/0x500835b7bd266a92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.621862:0:24299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+6:2411:x1875688963617792:12345-192.168.201.27@tcp:4:dd.0 Request processed in 96821us (97092us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788797119.621873:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 0 00000100:00100000:2.0:1788797119.621907:0:24299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:2.0:1788797119.621918:0:24299:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb3881a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2410:x1875688963617920:12345-192.168.201.27@tcp:4:dd.0 00002000:00010000:2.0:1788797119.621957:0:24299:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9ee0bf, atime: 0x6a9ee0bc, ctime: 0x6a9ee0bf, blocks: 0x2000 00010000:00010000:2.0:1788797119.621969:0:24299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.621980:0:24299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=835s v=(0 0) 00010000:00010000:2.0:1788797119.621985:0:24299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788797119.621991:0:24299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.622005:0:24299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.635966:0:24734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788797119.684899:0:24289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788797119.685145:0:24299:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788797119.685152:0:24299:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788797119.685168:0:24299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685182:0:24299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685200:0:24299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685208:0:24299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fb4830e8c00 already unused, calling callback (ffffffffc0d838b0) 00010000:00010000:2.0:1788797119.685213:0:24299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685222:0:24299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685258:0:24299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788797119.685266:0:24299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0e7bb33/0x500835b7bd266a99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788797119.685389:0:24299:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb3881a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2410:x1875688963617920:12345-192.168.201.27@tcp:4:dd.0 Request processed in 63468us (160564us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788797119.685400:0:24299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 1 00000100:00100000:2.0:1788797119.763951:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788797119.763975:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984706432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788797119.764058:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.764805:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984706944:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.764843:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.764866:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984707456:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.764887:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.764907:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788797119.764912:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984706816:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.764935:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.764966:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984707328:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.764986:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.765002:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984707840:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.765021:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.765067:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706944 00000100:00100000:0.0:1788797119.765080:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706944 00000100:00100000:3.0:1788797119.765117:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706432 00000100:00100000:3.0:1788797119.765122:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706432 00000100:00100000:0.0:1788797119.765127:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707456 00000100:00100000:0.0:1788797119.765129:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707456 00000100:00100000:3.0:1788797119.765159:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788797119.765169:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984706432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788797119.765199:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788797119.765243:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984706432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797119.765262:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788797119.765362:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984706560:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765396:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765424:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4beface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984707072:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765459:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765482:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984707584:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765502:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765514:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788797119.765519:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984706688:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765537:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765555:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984707200:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765575:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765611:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984707712:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765632:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788797119.765656:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706560 00000100:00100000:1.0:1788797119.765660:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706560 00000100:00100000:1.0:1788797119.765707:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788797119.765715:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3654:x1875688984706560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765750:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943c4c9d-8ce2-4132-a4c5-0a007618de16+24:3654:x1875688984706560:12345-0@lo:400:kworker.0 Request processed in 36us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797119.765757:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788797119.765785:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707072 00000100:00100000:1.0:1788797119.765789:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707072 00000100:00100000:1.0:1788797119.765804:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706688 00000100:00100000:1.0:1788797119.765807:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706688 00000100:00100000:1.0:1788797119.765820:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788797119.765826:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4beff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984707072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765858:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4beff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984707072:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797119.765864:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788797119.765876:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788797119.765882:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4beff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984706688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765907:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4beff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984706688:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797119.765913:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788797119.765945:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984706688:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765954:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943c4c9d-8ce2-4132-a4c5-0a007618de16:3654:1875688984706560:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.765963:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4beface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984707072:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.766003:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707328 00000100:00100000:1.0:1788797119.766007:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707328 00000100:00100000:1.0:1788797119.766026:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707840 00000100:00100000:1.0:1788797119.766030:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707840 00000100:00100000:2.0:1788797119.766603:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984706816 00000100:00100000:2.0:1788797119.766608:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984706816 00000100:00100000:0.0:1788797119.767006:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707584 00000100:00100000:0.0:1788797119.767011:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707584 00000100:00100000:0.0:1788797119.767040:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707712 00000100:00100000:0.0:1788797119.767052:0:24940:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707712 00000100:00100000:0.0:1788797119.767074:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788797119.767083:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984706944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767142:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875688984706944:12345-0@lo:400:kworker.0 Request processed in 61us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767148:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788797119.767177:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788797119.767183:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984707328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767353:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875688984707328:12345-0@lo:400:kworker.0 Request processed in 170us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767360:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788797119.767374:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797119.767380:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984707456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767406:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875688984707456:12345-0@lo:400:kworker.0 Request processed in 28us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767412:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797119.767424:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788797119.767429:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4beff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984707584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767472:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4beff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875688984707584:12345-0@lo:400:kworker.0 Request processed in 43us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767478:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788797119.767490:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797119.767495:0:24940:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4beff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984707712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767521:0:24940:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4beff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875688984707712:12345-0@lo:400:kworker.0 Request processed in 26us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767536:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788797119.767565:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707200 00000100:00100000:0.0:1788797119.767569:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707200 00000100:00100000:0.0:1788797119.767754:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788797119.767763:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4beff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984707200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.767799:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4beff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875688984707200:12345-0@lo:400:kworker.0 Request processed in 38us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.767804:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788797119.767860:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984706432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788797119.767878:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788797119.767888:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984707968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797119.767935:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797119.767979:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984707968 00000100:00100000:0.0:1788797119.767983:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984707968 00000100:00100000:0.0:1788797119.768001:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797119.768007:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875688984707968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788797119.768018:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788797119.768051:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875688984707968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797119.768056:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788797119.768082:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3656:1875688984707968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788797119.768128:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3654:1875688984707200:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.768138:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3654:1875688984707712:0@lo:400:kworker.0 00010000:00080000:0.0:1788797119.768150:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4befd4700 x1875688984707584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788797119.768179:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3654:1875688984707584:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.768919:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875688984707328:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.768934:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875688984706944:0@lo:400:kworker.0 00000100:00100000:0.0:1788797119.768944:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3657:1875688984707456:0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.773588:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788797119.775113:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788797119.775126:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984706816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.775396:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984707840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788797119.775507:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875688984707840:12345-0@lo:400:kworker.0 Request processed in 119us (10483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797119.775515:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788797119.775575:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fb4befd5180 x1875688984707840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788797135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788797119.775594:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3657:1875688984707840:0@lo:400:kworker.0 00000100:00100000:2.0:1788797119.776115:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984706816:12345-0@lo:400:kworker.0 Request processed in 991us (11176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797119.776124:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788797119.776435:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984706816:0@lo:400:kworker.0 00000100:00080000:3.0:1788797119.778456:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788797119.778508:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797119.778513:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788797119.778517:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788797120.661194:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788797120.788263:0:3654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984708096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788797120.788490:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797120.788719:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984708096 00000100:00100000:3.0:1788797120.788729:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984708096 00000100:00100000:3.0:1788797120.788779:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788797120.788990:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984708096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788797120.789019:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923509248 avail 3684282368 00000100:00100000:3.0:1788797120.789289:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875688984708096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 370us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797120.789307:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788797120.794119:0:3654:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788797120.794134:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fb4befadc00, transno 12884901892 00000004:00080000:1.0:1788797120.794148:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788797120.794193:0:3654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3654:1875688984708096:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788797121.365433:0:22823:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788797121.365444:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788797121.365463:0:22823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788797121.365471:0:22823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:3.0:1788797121.566052:0:25873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788797121.688574:0:22776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788797121.813367:0:3655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984708224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788797121.813449:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797121.813960:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788797121.813971:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4befd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984708352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788797121.814006:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788797121.814036:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984708352 00000100:00100000:0.0:1788797121.814043:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984708352 00000100:00100000:0.0:1788797121.814090:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797121.814099:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984708352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788797121.814146:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788797121.814194:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875688984708352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797121.814202:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788797121.814794:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3657:1875688984708352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788797121.816712:0:24297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984708224 00000100:00100000:2.0:1788797121.816725:0:24297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984708224 00000100:00100000:2.0:1788797121.816789:0:24297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788797121.816800:0:24297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984708224:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788797121.816925:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788797121.817204:0:24297:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1788797121.817374:0:24297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875688984708224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 576us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788797121.817382:0:24297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788797121.817853:0:3655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4befa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3655:1875688984708224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788797121.820993:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788797121.821013:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788797121.821085:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788797121.821162:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688984708480 00000100:00100000:3.0:1788797121.821171:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688984708480 00000100:00100000:3.0:1788797121.821344:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797121.821354:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984708480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788797121.821388:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788797121.821448:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4bfb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875688984708480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797121.821455:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788797121.821516:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fb4b9ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3656:1875688984708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788797122.372579:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.372630:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.372660:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:0.0:1788797122.372908:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618176 00000100:00100000:0.0:1788797122.372921:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618176 00000100:00100000:0.0:1788797122.372998:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618688 00000100:00100000:0.0:1788797122.373002:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618688 00000100:00100000:0.0:1788797122.373026:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:0.0:1788797122.373037:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:2411:x1875688963618176:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788797122.373128:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5596e1-adfd-4fce-a2cd-12fb575d153a+22:2411:x1875688963618176:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 92us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797122.373136:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 71 00000100:00100000:0.0:1788797122.373161:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 72 00000100:00100000:0.0:1788797122.373168:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2411:x1875688963618688:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:0.0:1788797122.373191:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+6:2411:x1875688963618688:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788797122.373196:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 72 00000100:00080000:0.0:1788797122.373234:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788797122.374205:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618432 00000100:00100000:3.0:1788797122.374216:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618432 00000100:00100000:3.0:1788797122.374785:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:3.0:1788797122.374799:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618432:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797122.374864:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618432:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 70us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797122.374871:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 26 00000100:00100000:2.0:1788797122.375447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.375791:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.375825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.375845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797122.375898:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618048 00000100:00100000:1.0:1788797122.375907:0:22782:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618048 00000100:00100000:1.0:1788797122.375966:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 170 00000100:00100000:1.0:1788797122.375975:0:22782:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2411:x1875688963618048:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788797122.376020:0:22782:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb387880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:268b5117-b5e2-4f6e-ae4a-1da250176944+13:2411:x1875688963618048:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797122.376027:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 170 00000100:00100000:1.0:1788797122.376059:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618304 00000100:00100000:1.0:1788797122.376063:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618304 00000100:00100000:1.0:1788797122.376104:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00100000:1.0:1788797122.376124:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618304:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788797122.376152:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618304:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797122.376158:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 73 00000100:00080000:0.0:1788797122.376579:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788797122.376584:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788797122.384331:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:2.0:1788797122.384371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.27@tcp (source: 12345-192.168.201.27@tcp) 00000100:00100000:1.0:1788797122.384414:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618816 00000100:00100000:1.0:1788797122.384426:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618816 00000100:00100000:1.0:1788797122.384486:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:1.0:1788797122.384497:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963618816:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788797122.384589:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963618816:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797122.384596:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 74 00000100:00100000:3.0:1788797122.387623:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618944 00000100:00100000:3.0:1788797122.387640:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618944 00000100:00100000:1.0:1788797122.387848:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963618560 00000100:00100000:1.0:1788797122.387854:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963618560 00000100:00100000:1.0:1788797122.387893:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1788797122.387905:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963618944:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788797122.388001:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963618944:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 98us (12556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797122.388008:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 27 00000100:00100000:1.0:1788797122.388028:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00100000:1.0:1788797122.388034:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618560:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:1.0:1788797122.388057:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5596e1-adfd-4fce-a2cd-12fb575d153a+5:2411:x1875688963618560:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 24us (12211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788797122.388062:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 28 00000100:00080000:1.0:1788797122.388120:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788797122.388138:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788797122.388141:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788797122.389650:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688963619072 00000100:00100000:3.0:1788797122.389662:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688963619072 00000100:00080000:1.0:1788797122.389852:0:22783:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788797122.389951:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.27@tcp, seq: 29 00000100:00100000:3.0:1788797122.389964:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8fb4befa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963619072:12345-192.168.201.27@tcp:400:kworker.0 00000100:00100000:3.0:1788797122.390036:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8fb4befa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a5cbfba-8f07-4e59-bbd0-2b97b41d27c6+5:2411:x1875688963619072:12345-192.168.201.27@tcp:400:kworker.0 Request processed in 75us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788797122.397622:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.27@tcp, seq: 29 00010000:00010000:2.0:1788797122.716223:0:24735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14399 lines, 14399 kept, 0 dropped, 0 bad.